-- Logs begin at Mon 2022-07-18 13:27:27 UTC, end at Mon 2022-07-18 14:36:03 UTC. -- Jul 18 13:59:44.552458 dv-cinder-849846-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 13:59:44.561414 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 13:59:44 2022] *** Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: nodename: dv-cinder-849846-1-iscsi Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: machine: x86_64 Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: clock source: unix Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: pcre jit disabled Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: detected number of CPU cores: 4 Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: current working directory: / Jul 18 13:59:44.563392 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: detected binary path: /usr/bin/uwsgi-core Jul 18 13:59:44.564039 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: your processes number limit is 47680 Jul 18 13:59:44.564039 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: your memory page size is 4096 bytes Jul 18 13:59:44.564039 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: detected max file descriptor number: 2048 Jul 18 13:59:44.564039 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: lock engine: pthread robust mutexes Jul 18 13:59:44.564039 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: thunder lock: enabled Jul 18 13:59:44.564039 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 13:59:44.564039 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 13:59:44.603138 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: Python main interpreter initialized at 0x55be799ce9c0 Jul 18 13:59:44.603138 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: python threads support enabled Jul 18 13:59:44.603138 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: your server socket listen backlog is limited to 100 connections Jul 18 13:59:44.603138 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: your mercy for graceful operations on workers is 90 seconds Jul 18 13:59:44.603449 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 13:59:44.603548 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: *** Operational MODE: preforking *** Jul 18 13:59:44.603801 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: *** uWSGI is running in multiple interpreter mode *** Jul 18 13:59:44.603801 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: spawned uWSGI master process (pid: 103322) Jul 18 13:59:44.604004 dv-cinder-849846-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 13:59:44.605337 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: spawned uWSGI worker 1 (pid: 103323, cores: 1) Jul 18 13:59:44.605337 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: spawned uWSGI worker 2 (pid: 103324, cores: 1) Jul 18 13:59:44.605337 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 13:59:45.257851 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 13:59:45.264664 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 13:59:46.359112 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:59:46.359112 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: from cryptography.utils import int_from_bytes Jul 18 13:59:46.359673 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:59:46.359673 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: from cryptography.utils import int_from_bytes Jul 18 13:59:46.360096 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:59:46.360096 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: from cryptography.utils import int_from_bytes Jul 18 13:59:46.360216 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:59:46.360216 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: from cryptography.utils import int_from_bytes Jul 18 13:59:48.838255 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 13:59:48.838918 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 13:59:48.839279 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 13:59:48.839368 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 13:59:48.839458 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 13:59:48.839538 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 13:59:48.839605 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 13:59:48.839680 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 13:59:48.839759 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 13:59:48.839832 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 13:59:48.840026 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.840125 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.840301 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.840449 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.840620 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.840772 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.840935 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.841095 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.841261 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.841428 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.841569 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.841741 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.841887 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.842063 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.842201 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.842382 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.842524 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.842710 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.842805 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.842970 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.843071 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.843292 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.843433 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-1-iscsi {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.843614 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-1-iscsi {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.843712 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.843937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.844051 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.844268 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.844373 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.844578 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.844679 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.844894 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.844991 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.845197 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.845295 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.845501 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.845591 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.845812 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.845991 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.846315 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.846418 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.846626 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.846733 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.846938 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.847038 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.847247 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.847340 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.847583 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.847685 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.847898 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.848031 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.848233 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.848325 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.848538 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.848635 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.848846 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.848944 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.849148 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.849253 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.849460 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.849558 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-1-iscsi {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.849836 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.849934 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-1-iscsi {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.850144 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.850751 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.850985 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.851077 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.851298 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.851389 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.851688 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.851793 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.852017 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.852174 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.852341 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.852429 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.852648 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.852735 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.852954 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.853051 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.853274 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.853360 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.853598 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.853695 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.853915 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.854009 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.854230 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.854316 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.854530 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.854631 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.854835 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.854922 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.855138 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.855302 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.855448 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.855547 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.855748 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.855845 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.856073 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.856191 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.856326 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.856427 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.856617 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.856715 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.856931 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.857018 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.857244 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.857339 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.857562 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.857649 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.857810 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.857899 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.858057 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.858147 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.858359 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.858446 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.858674 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.858776 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.858977 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.859072 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.859278 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.859366 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.859581 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.859669 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.859885 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.860024 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.860214 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.860299 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.860514 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.860610 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.860815 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.860902 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.861116 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.861204 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.861420 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.861514 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.861727 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.861818 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.862039 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.862125 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.862340 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.862426 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.862651 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.862737 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.862970 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.863065 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.863284 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.863379 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.863587 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.863673 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.863904 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.864026 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.864250 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.864337 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.864557 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.864643 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.864866 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.864961 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.865182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.865275 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.865485 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.865576 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.865787 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.865892 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.866673 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.866794 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.866988 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.867124 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.867309 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.867459 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.867643 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.867765 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.867966 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.868057 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.868230 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.868338 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.868532 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.868632 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.868837 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.868937 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.869156 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.869259 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.869461 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.869548 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.869767 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.869853 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.870072 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.870161 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.870373 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.870460 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.870676 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.870762 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.870977 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.871072 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.871277 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.871362 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.871578 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.871676 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.871876 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.871982 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.872206 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.872314 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.872509 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.872609 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.872810 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.872906 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.873115 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.873202 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.873434 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.873534 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.873734 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.873821 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.874036 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.874123 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.874337 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.874433 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.874636 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.874735 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.874936 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.875023 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.875239 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.875404 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.875537 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.875627 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.875834 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.875920 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.876157 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.876265 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.876460 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.876554 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.876762 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.876861 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.877062 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.877162 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.877363 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.877450 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.877665 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.877751 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.877962 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.878063 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.878262 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.878357 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.878564 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.878649 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.878862 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.878948 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.879161 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.879247 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.879458 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.879546 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.879756 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.879844 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.880077 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.880181 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.880379 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.880465 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.880677 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.880763 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.880976 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.881063 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.881273 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.881368 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.881596 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.881684 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.881917 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.882004 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.882219 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.882321 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.882522 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.882610 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.882824 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.882909 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.883129 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.883225 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.883446 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:59:48.883542 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.883775 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.883862 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.884139 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.884244 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.884454 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.884551 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.884781 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.884876 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.885109 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.885206 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.885419 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.885512 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.885726 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.885813 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.886036 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.886124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.886346 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.886440 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.886652 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.886738 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.886961 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.887063 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.887265 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.887361 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.887576 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.887661 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.887885 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.888027 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.888230 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.888328 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.888544 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.888630 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.888856 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.888949 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.889169 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.889257 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.889479 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.889567 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.889789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.889887 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.890107 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.890195 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.890422 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.890507 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.890731 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.890830 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.891040 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.891126 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.891380 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.891477 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.891691 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.891777 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.892035 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.892126 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.892357 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.892458 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.892666 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.892760 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.892975 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.893061 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.893284 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.893384 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.893596 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.893684 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.893919 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.894006 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.894226 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.894322 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.894542 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.894630 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.894851 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.894938 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.895159 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.895247 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.895468 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.895554 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.895771 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.895857 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.896105 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.896194 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.896421 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.896508 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.896733 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.896821 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.897047 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.897146 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.897380 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.897467 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.897696 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.897783 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.898005 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.898096 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.898312 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.898401 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.898618 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.898712 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.898919 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.899007 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.899220 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.899312 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.899522 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.899618 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.899826 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.899913 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.900149 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.900237 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.900457 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.900556 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.900776 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.900875 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.901081 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.901168 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.901392 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.901487 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.901701 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.901794 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.902007 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.902138 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.902314 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.902415 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.902620 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.902713 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.902921 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.903007 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.903228 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.903315 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.903533 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.903625 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.903837 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.903930 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.904169 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.904258 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.904476 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.904563 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.904779 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.904867 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.905083 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.905170 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.905388 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.905474 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.905692 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.905787 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.905999 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.906086 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.906304 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.906390 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.906612 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.906708 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.906919 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.907013 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.907230 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.907329 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.907536 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.907637 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.907843 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.907929 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.908175 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.908265 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.908486 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.908581 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.908819 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.908912 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.909124 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.909261 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.909440 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.909528 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.909756 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.909850 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.910071 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.910158 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.910373 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.910461 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.910673 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.910760 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.910971 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.911059 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.911271 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.911360 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.911572 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.911666 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.911873 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.911987 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.912199 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.912334 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.912501 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.912595 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.913334 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.913431 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.913637 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.913724 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.913941 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.914027 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.914247 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.914344 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.914550 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.914636 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.914851 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.914938 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.915151 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.915251 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.915450 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.915538 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.915749 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.915835 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.916100 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.916204 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.916438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.916526 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.916769 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.916858 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.917082 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.917171 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.917405 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.917512 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.917709 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.917799 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.918021 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.918109 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.918327 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.918416 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.918632 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.918719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.918939 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.919035 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.919247 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.919380 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.919558 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.919655 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.919861 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.919970 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.920199 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.920286 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.920503 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.920600 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.920818 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.920906 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.921121 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.921207 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.921434 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.921530 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.921737 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.921824 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.922039 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.922125 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.922356 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.922451 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.922684 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.922770 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.922994 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.923081 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.923318 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.923412 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.923622 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.923708 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.923931 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.924081 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.924257 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.924354 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.924562 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.924651 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.924866 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.924952 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.925170 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.925265 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.925481 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.925568 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.925786 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.925871 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.926093 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.926187 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.926396 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.926482 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.926705 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.926791 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.927008 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.927098 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.927320 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.927420 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.927625 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.927724 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.927924 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.928035 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.928260 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.928347 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.929149 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.929244 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.929487 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.929577 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.929796 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.929883 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.930105 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.930201 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.930410 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.930506 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.930716 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.930804 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.931022 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.931116 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.931321 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.931409 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.931623 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.931709 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.931926 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.932093 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.932259 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.932352 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.932565 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.932665 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.932871 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.932968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.933174 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.933262 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.933477 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.933562 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.933783 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.933871 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.934085 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.934174 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.934388 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.934475 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.934694 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.934783 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.935005 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.935093 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.935309 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.935404 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.935620 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.935708 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.935936 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.936105 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.936262 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.936376 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.936565 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.936682 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.936872 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.936993 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.937185 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.937308 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.937488 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.937618 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.937799 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.937919 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.938078 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.938203 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.938379 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.938492 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.938710 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.938823 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.939011 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.939135 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.939313 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.939425 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.939627 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.939741 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.939933 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.940082 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.940265 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.940380 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.940572 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.940687 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.940879 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.940993 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.941191 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.941313 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.941499 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.941611 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.941805 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.941894 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.942111 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.942197 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.942417 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.942502 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.942724 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.942839 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.943030 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.943146 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.943342 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.943463 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.943654 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.943768 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.944004 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.944126 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.944326 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.944460 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.944630 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.945015 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.945200 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.945313 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.945512 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.945637 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.945833 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.946079 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.946401 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.946517 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.946712 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.946837 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.947031 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.947155 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.947755 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.947916 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948085 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948172 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948253 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948332 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948411 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948498 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948610 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948706 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.948911 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.949008 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.949220 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.949322 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.949523 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.949611 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.949826 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.949914 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.950133 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.950230 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.950436 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.950524 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.950738 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.950826 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.951038 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.951135 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.951341 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.951429 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.951630 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.951727 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.951929 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.952080 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.952252 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.952354 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.952554 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.952642 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.952859 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.952946 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.953157 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.953254 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.953464 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.953559 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.953763 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.953850 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.954066 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.954167 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.954378 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.954465 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.954681 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.954776 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.954982 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.955082 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.955281 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.955369 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.955582 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.955676 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.955908 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.956015 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.956245 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.956332 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.956580 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.956668 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.956911 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.956999 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.957215 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.957303 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.957520 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.957611 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.957839 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.957927 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.958139 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.958228 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.958441 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.958543 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.958743 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.958831 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.959044 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.959145 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.959348 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.959448 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.959676 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.959773 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.960005 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.960098 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.960314 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.960414 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.960620 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.960707 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.960926 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.961021 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.961228 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.961330 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.961528 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.961654 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.961828 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.961913 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.962129 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.962219 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.962432 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.962518 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.962733 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.962829 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.963033 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.963128 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.963338 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.963428 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.963640 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.963727 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.963951 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.964042 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.964269 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.964367 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.964568 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.964654 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.964870 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.964958 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.965174 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.965260 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.965476 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.965573 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.965779 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.965866 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.966083 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.966177 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.966390 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.966491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.966692 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.966787 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.967001 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.967088 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.967327 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.967425 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.967640 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.967738 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.967978 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.968071 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.968275 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.968383 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.968587 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.968694 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.968888 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.968982 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.969187 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.969287 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.969499 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.969587 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.969812 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.969898 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.970114 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.970216 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.970416 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.970503 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.970717 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.970804 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.971019 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.971107 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.971319 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.971407 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.971621 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.971703 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.971922 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.972077 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.972245 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.972347 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.972548 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.972666 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.972858 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.973022 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.973147 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.973233 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.973450 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.973551 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.973765 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.973851 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.974068 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.974155 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.974368 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.974464 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.974666 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.974753 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.974965 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.975053 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.975822 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.975931 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.976160 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.976248 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.976499 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.976585 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.976817 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.976907 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.977134 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.977221 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.977442 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.977529 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.977751 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.977842 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.978063 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.978158 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.978361 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.978450 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.978669 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.978757 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.978975 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.979070 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.979283 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.979370 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.979584 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.979672 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.979884 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.980004 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.980230 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.980327 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.980540 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.980638 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.980850 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.980937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.981158 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.981253 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.981478 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.981573 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.981800 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.981886 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.982100 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.982197 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.982406 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.982494 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.982711 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.982806 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.983017 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.983113 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.983325 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.983413 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.983629 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.983716 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.983936 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.984068 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.984266 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.984354 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.984574 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.984669 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.984880 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.984977 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.985188 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.985276 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.985491 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.985579 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.985795 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.985883 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.986099 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.986186 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.986401 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.986490 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.986705 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.986802 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.987015 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.987110 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.987317 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.987412 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.987625 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.987750 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.987924 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.988038 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.988249 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.988355 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.988552 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.988649 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.988862 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.988974 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.989280 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.989377 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.989589 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.989676 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.989890 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.989977 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.990193 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.990288 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.990498 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.990584 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.990825 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.990941 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.991685 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.991784 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.992026 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.992119 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.992337 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.992450 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.992757 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.992847 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.993064 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.993152 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.993374 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.993470 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.993675 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.993770 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.993978 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.994073 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.994282 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.994368 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.994593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.994683 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.994891 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.994977 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.995193 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.995280 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.995495 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.995584 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.995798 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.995885 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.996161 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.996470 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.996559 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.996791 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.996894 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.997215 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.997304 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.997526 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.997616 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.997832 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.997967 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.998247 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.998336 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.998559 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.998649 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.998871 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.998959 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.999196 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.999283 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.999518 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.999606 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:48.999841 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.000207 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.000304 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.000414 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.000505 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.000588 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.000773 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.000863 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.001098 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.001195 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.001424 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.001521 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.001736 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.001826 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.002053 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.002141 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.002357 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.002454 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.002680 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.002767 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.003001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.003096 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.003314 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.003410 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.003637 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.003723 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.004078 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.004171 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.004405 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.004507 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.004713 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.004801 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.005031 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.005118 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.005352 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.005441 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.005660 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.005755 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.005962 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.006049 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.006270 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.006359 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.006616 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.006706 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.006922 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.007009 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.007247 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.007345 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.007550 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.007637 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.007860 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.008017 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.008195 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.008330 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.008506 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.008640 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.008814 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.008939 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.009119 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.009249 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.009443 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.009580 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.009748 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.009886 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.010072 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.010213 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.010387 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.010532 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.010711 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.010859 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.011034 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.011187 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.011341 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.011498 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.011661 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.011824 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.012021 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.012164 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.012332 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.012474 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.012639 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.012783 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.012943 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.013089 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.013286 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.013436 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.013596 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.013733 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.013918 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.014059 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.014248 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.014392 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.014579 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.014726 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.014891 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.015041 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.015223 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.015378 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.015548 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.015709 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.015864 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.016053 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.016203 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.016376 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.016526 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.016704 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.016830 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.017018 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.017133 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.017325 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.017441 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.017638 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.017746 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.017948 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.018088 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.018256 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.018348 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.018563 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.018659 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.018874 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.018962 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.019181 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.019271 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.019486 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.019575 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.019789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.019886 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.020117 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.020206 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.020437 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.020526 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.020748 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.020893 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.021052 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.021142 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.021357 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.021444 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.021655 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.021750 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.021956 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.022050 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.022828 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.022918 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.023138 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.023236 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.023466 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.023554 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.023786 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.023880 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.024140 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.024232 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.024449 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.024537 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.024772 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.024860 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.025085 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.025173 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.025399 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.025494 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.025714 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.025802 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.026024 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.026113 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.026337 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.026432 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.026646 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.026733 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.026956 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.027046 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.027264 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.027352 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.027572 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.027673 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.027880 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.027997 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.028222 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.028310 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.028540 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.028739 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.029065 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.029188 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.029377 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.029464 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.029690 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.029789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.030003 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.030092 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.030317 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.030403 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.030625 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.030722 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.030937 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.031025 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.031248 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.031335 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.031557 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.031656 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.031868 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.031981 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.032209 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.032300 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.032529 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.032626 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.032852 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.032940 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.033181 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.033269 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.033496 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.033594 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.033808 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.033897 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.034127 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.034223 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.034437 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.034524 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.034751 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.034838 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.035089 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.035186 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.035394 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.035483 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.035704 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.035793 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.036043 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.036135 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.036357 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.036444 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.036669 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.036766 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.036977 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.037067 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.037286 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.037373 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.037595 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.037720 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.038469 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.038561 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.038788 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.038877 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.039098 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.039206 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.039409 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.039498 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.039724 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.039813 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.040076 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.040185 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.040395 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.040484 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.040707 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.040795 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.041022 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.041112 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.041337 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.041437 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.041658 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.041850 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.042162 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.042264 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.042481 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.042576 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.042800 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.042925 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.043122 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.043214 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.043436 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.043524 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.043750 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.043838 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.044092 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.044182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.044398 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.044487 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.044702 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.044806 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.045010 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.045098 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.045317 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.045406 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.045620 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.045717 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.045924 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.046012 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.046236 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.046322 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.046536 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.046638 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.046838 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.046924 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.047145 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.047232 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.047464 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.047673 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.048023 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.048118 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.048355 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.048444 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.048676 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.048764 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.049000 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.049086 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.049317 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.049405 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.049626 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.049717 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.049932 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.050019 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.050246 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.050334 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.050553 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.050641 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.050860 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.050948 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.051163 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.051251 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.051465 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.051562 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.051767 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.051856 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.052095 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.052197 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.052402 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.052489 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.052705 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.052793 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.053008 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.053141 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.053305 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.053411 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.053638 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.053725 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.053948 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.054050 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.054252 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.054340 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.054556 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.054645 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.054860 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.054960 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.055161 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.055249 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.055461 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.055556 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.055761 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.055849 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.056089 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.056181 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.056397 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.056488 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.056695 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.056784 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057004 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057092 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057304 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057390 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057607 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057696 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057906 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.057992 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.058211 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.058298 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.058522 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.058657 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.058865 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.058955 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.059167 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.059265 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.059467 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.059555 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.059773 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.059861 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.060099 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.060200 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.060416 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.060503 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.060722 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.060809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.061028 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.061130 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.061339 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.061435 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.061670 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.061757 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.061990 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.062194 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.062524 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.062611 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.062843 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.062930 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.063174 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.063272 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.063504 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.063592 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.063809 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.063904 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.064144 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.064235 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.064449 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.064539 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.064764 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.064859 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.065073 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.065161 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.065382 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.065478 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.065689 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.065776 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.065998 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.066096 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.066307 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.066396 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.066615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.066713 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.066923 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.067011 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.067233 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.067322 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.067544 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.067641 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.067849 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.067937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.068186 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.068275 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.068498 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.068597 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.068812 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.068891 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.069152 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.069241 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.069471 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.069569 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.070067 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.070159 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.070386 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.070474 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.070703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.070792 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.071015 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.071113 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.071324 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.071412 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.071632 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.071723 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.071980 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.072072 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.072267 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.072373 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.072580 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.072668 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.072895 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.072981 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.073207 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.073342 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.073510 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.073598 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.073823 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.073931 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.074241 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.074343 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.074558 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.074646 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.074873 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.074960 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.075182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.075272 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.075490 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.075576 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.075808 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.075894 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.076152 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.076239 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.076474 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.076550 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.076784 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.076861 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.077155 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.077243 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.077488 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.077577 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.077827 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.077924 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.078147 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.078235 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.078454 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.078541 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.078759 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.078856 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.079063 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.079162 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.079369 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.079456 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.079681 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.079777 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.080010 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.080102 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.080315 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.080406 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.080616 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.080713 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.080919 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.081006 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.081217 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.081312 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.081515 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.081614 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.081816 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.081913 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.082118 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.082206 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.082421 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.082510 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.082717 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.082804 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.083019 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.083107 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.083319 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.083456 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.083619 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.083707 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.083919 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.084078 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.084240 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.084330 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.084544 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.085148 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.085365 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.085462 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.085668 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.085756 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.085965 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.086051 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.086265 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.086366 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.086561 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.086648 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.086862 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.086950 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.087199 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.087296 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.087508 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.087595 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.087827 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.087914 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.088158 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.088252 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.088520 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.088624 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.088784 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.088873 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.089096 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.089185 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.089412 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.089507 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.089725 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.089827 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.090032 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.090122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.090342 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.090429 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.090659 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.090746 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.090967 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.091057 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.091273 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.091362 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.091582 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.091679 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.091890 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.091997 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.092223 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.092311 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.092534 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.092633 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.092854 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.092941 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.093159 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.093247 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.093472 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.093568 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.093786 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.093881 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.094104 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.094192 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.094416 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.094505 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.094725 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.094814 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.095034 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.095131 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.095346 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.095436 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.095655 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.095752 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.095980 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.096072 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.096294 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.096385 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.096603 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.096690 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.096913 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.097015 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.097221 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.097310 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.097529 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.097618 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.097839 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.097935 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.098151 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.098240 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.098465 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.098552 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.098789 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.098885 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.099099 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.099227 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.099411 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.099500 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.099733 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.099829 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.100083 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.100175 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.100992 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.101089 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.101308 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.101397 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.101656 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.101746 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.101970 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.102066 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.102287 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.102418 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.102592 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.102689 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.102836 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 13:59:49.102924 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:59:49.103132 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 13:59:49.162220 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO dbcounter [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Registered counter for database nova_api Jul 18 13:59:49.162401 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO dbcounter [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Registered counter for database nova_api Jul 18 13:59:49.274936 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_db.sqlalchemy.engines [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.276523 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_db.sqlalchemy.engines [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.281431 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writer thread running {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.282844 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writer thread running {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.337456 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.context [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9(cell1) {{(pid=103323) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 13:59:49.339005 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.context [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9(cell1) {{(pid=103324) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 13:59:49.341418 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:49.342898 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_concurrency.lockutils [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:49.343006 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:49.343742 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:49.344483 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_concurrency.lockutils [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:49.345292 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_concurrency.lockutils [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 13:59:49.345871 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:49.347403 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_concurrency.lockutils [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 13:59:49.347851 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO dbcounter [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Registered counter for database nova_cell0 Jul 18 13:59:49.349382 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO dbcounter [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Registered counter for database nova_cell0 Jul 18 13:59:49.352637 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO dbcounter [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Registered counter for database nova_cell1 Jul 18 13:59:49.353772 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO dbcounter [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Registered counter for database nova_cell1 Jul 18 13:59:49.359911 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_db.sqlalchemy.engines [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.361683 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_db.sqlalchemy.engines [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.363662 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_db.sqlalchemy.engines [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.365222 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writer thread running {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.365976 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_db.sqlalchemy.engines [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.368042 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writer thread running {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.512184 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writer thread running {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.520912 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO dbcounter [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Registered counter for database nova_cell0 Jul 18 13:59:49.523797 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writer thread running {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.527696 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_db.sqlalchemy.engines [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.531902 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writer thread running {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.533267 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO dbcounter [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Registered counter for database nova_cell0 Jul 18 13:59:49.542351 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG oslo_db.sqlalchemy.engines [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:59:49.546634 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writer thread running {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:59:49.870005 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: WARNING keystonemiddleware.auth_token [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 13:59:49.877334 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: WARNING keystonemiddleware.auth_token [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 13:59:49.878356 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: WARNING keystonemiddleware.auth_token [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 13:59:49.885809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: WARNING keystonemiddleware.auth_token [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 13:59:50.217791 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: WARNING keystonemiddleware.auth_token [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 13:59:50.223714 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: WARNING keystonemiddleware.auth_token [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 13:59:50.227742 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: WARNING keystonemiddleware.auth_token [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 13:59:50.228974 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be799ce9c0 pid: 103323 (default app) Jul 18 13:59:50.231028 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 13:59:50.232220 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] 10.222.0.94 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jul 18 13:59:50.232635 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 1/1] 10.222.0.94 () {50 vars in 788 bytes} [Mon Jul 18 13:59:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 13:59:50.233722 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: WARNING keystonemiddleware.auth_token [None req-51ba615a-afe8-4ec8-a58d-75cbb360b5dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 13:59:50.238976 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be799ce9c0 pid: 103324 (default app) Jul 18 14:01:05.092684 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:05.093672 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 18 14:01:05.094053 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 2/2] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:05.106493 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writing DB stats nova_api:SELECT=3 {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:05.107464 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writing DB stats nova_cell1:SELECT=3 {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:05.109024 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writing DB stats nova_cell0:SELECT=3 {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:05.109797 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:05.955706 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-cdc0de47-76ab-4abc-a3bb-77226bb2e8ac admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:05.989591 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-cdc0de47-76ab-4abc-a3bb-77226bb2e8ac admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.888623 Jul 18 14:01:05.991150 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 1/3] 10.222.0.94 () {60 vars in 1291 bytes} [Mon Jul 18 14:01:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:08.186861 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:08.188018 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-c68e8b8d-08a4-4050-a478-45d3bf5cca57 None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 14:01:08.188489 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 3/4] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:08.644001 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-cd88568d-da57-4716-8d87-88ca574d1e68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "vcpus": 1, "id": "c1", "disk": 1}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:08.663292 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:01:08.663292 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: warnings.warn(msg) Jul 18 14:01:08.691217 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-cd88568d-da57-4716-8d87-88ca574d1e68 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496408 Jul 18 14:01:08.692041 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 2/5] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:01:08.706014 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_api:SELECT=3 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:08.706875 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_cell1:SELECT=3 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:08.707524 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_cell0:SELECT=3 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:08.708284 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:08.912202 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-dd69f70c-f121-41ec-8320-63c54c314663 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:08.914617 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:01:08.914617 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: warnings.warn(msg) Jul 18 14:01:08.982080 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-dd69f70c-f121-41ec-8320-63c54c314663 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282146 Jul 18 14:01:08.982867 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 4/6] 10.222.0.94 () {64 vars in 1335 bytes} [Mon Jul 18 14:01:08 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:11.217324 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-cd88568d-da57-4716-8d87-88ca574d1e68 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:11.218260 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-cd88568d-da57-4716-8d87-88ca574d1e68 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 18 14:01:11.218655 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 3/7] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:11.877417 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-62292704-0837-483c-9f92-229f149b0c9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:11.896988 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:01:11.896988 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: warnings.warn(msg) Jul 18 14:01:11.916683 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-62292704-0837-483c-9f92-229f149b0c9c admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691934 Jul 18 14:01:11.924067 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 5/8] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:01:11.930000 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-fe169560-a375-44fe-bc30-b7cdc4bef237 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:11.931496 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:01:11.931496 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: warnings.warn(msg) Jul 18 14:01:11.969615 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-fe169560-a375-44fe-bc30-b7cdc4bef237 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043273 Jul 18 14:01:11.979974 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 4/9] 10.222.0.94 () {64 vars in 1335 bytes} [Mon Jul 18 14:01:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:14.200294 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-62292704-0837-483c-9f92-229f149b0c9c admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:14.202043 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-62292704-0837-483c-9f92-229f149b0c9c admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Jul 18 14:01:14.203547 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 6/10] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:14.569952 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-103cdd3d-2b1a-43d5-b925-d06ec2e6d91d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:14.588313 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-103cdd3d-2b1a-43d5-b925-d06ec2e6d91d admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.379704 Jul 18 14:01:14.588929 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 5/11] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:01:14.600724 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-17491a32-fe6d-4bab-b734-f6acdf39b571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:14.622995 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-17491a32-fe6d-4bab-b734-f6acdf39b571 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025925 Jul 18 14:01:14.624231 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 7/12] 10.222.0.94 () {64 vars in 1335 bytes} [Mon Jul 18 14:01:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:16.820981 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-103cdd3d-2b1a-43d5-b925-d06ec2e6d91d admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:16.821997 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-103cdd3d-2b1a-43d5-b925-d06ec2e6d91d admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 18 14:01:16.822655 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 6/13] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:17.247986 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-62e04163-ca3a-48e3-aa00-c2f15cda09c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:17.265078 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-62e04163-ca3a-48e3-aa00-c2f15cda09c6 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436273 Jul 18 14:01:17.265820 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 8/14] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:01:17.277728 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-565cde2d-3689-4f2f-8dc4-dadef5d91ae2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:17.300859 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-565cde2d-3689-4f2f-8dc4-dadef5d91ae2 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026829 Jul 18 14:01:17.301429 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 7/15] 10.222.0.94 () {64 vars in 1335 bytes} [Mon Jul 18 14:01:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:19.523913 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-62e04163-ca3a-48e3-aa00-c2f15cda09c6 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:19.524979 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-62e04163-ca3a-48e3-aa00-c2f15cda09c6 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 18 14:01:19.525548 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 9/16] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:19.983577 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-80ce867a-86cc-424b-830d-a31c8e369ed6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:20.002310 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-80ce867a-86cc-424b-830d-a31c8e369ed6 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470622 Jul 18 14:01:20.006792 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 8/17] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:01:20.015400 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-fda13a79-297e-4033-9474-0067ed7c17c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:20.039582 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-fda13a79-297e-4033-9474-0067ed7c17c5 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028165 Jul 18 14:01:20.045405 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 10/18] 10.222.0.94 () {64 vars in 1335 bytes} [Mon Jul 18 14:01:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:22.409409 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-80ce867a-86cc-424b-830d-a31c8e369ed6 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:22.410429 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-80ce867a-86cc-424b-830d-a31c8e369ed6 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 18 14:01:22.410834 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 9/19] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:22.825681 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-79beba06-ad70-4959-94e3-4cd72c8f97b5 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:22.855002 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-79beba06-ad70-4959-94e3-4cd72c8f97b5 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437720 Jul 18 14:01:22.855618 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 11/20] 10.222.0.94 () {60 vars in 1291 bytes} [Mon Jul 18 14:01:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:01:25.125848 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-80ce867a-86cc-424b-830d-a31c8e369ed6 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:25.126854 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-80ce867a-86cc-424b-830d-a31c8e369ed6 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 18 14:01:25.127255 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 10/21] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:25.530892 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-e08cd658-3515-4261-b9ce-baee454946ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "disk": 1, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:25.551600 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-e08cd658-3515-4261-b9ce-baee454946ef admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.417903 Jul 18 14:01:25.552324 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 12/22] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:01:25.566955 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-39a1021e-e11b-41fe-82b1-77ffade5183a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:25.590243 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-39a1021e-e11b-41fe-82b1-77ffade5183a admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027224 Jul 18 14:01:25.590814 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 11/23] 10.222.0.94 () {64 vars in 1332 bytes} [Mon Jul 18 14:01:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:28.084795 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-e08cd658-3515-4261-b9ce-baee454946ef admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:28.085893 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-e08cd658-3515-4261-b9ce-baee454946ef admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Jul 18 14:01:28.086361 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 13/24] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:28.480903 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-52754551-1bb1-49fb-9534-d4676ba85f6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "disk": 20, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:28.499607 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-52754551-1bb1-49fb-9534-d4676ba85f6a admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406829 Jul 18 14:01:28.500110 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 12/25] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:01:28.511846 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-6f9bbbc3-17af-45e9-97d9-842212f9790e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:28.534146 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-6f9bbbc3-17af-45e9-97d9-842212f9790e admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026057 Jul 18 14:01:28.534690 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 14/26] 10.222.0.94 () {64 vars in 1332 bytes} [Mon Jul 18 14:01:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:30.730032 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-52754551-1bb1-49fb-9534-d4676ba85f6a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:30.731102 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-52754551-1bb1-49fb-9534-d4676ba85f6a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 18 14:01:30.732193 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 13/27] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:31.109982 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-8788204b-10f2-4dec-9c36-290f42316ee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "disk": 40}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:31.130190 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-8788204b-10f2-4dec-9c36-290f42316ee7 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.392262 Jul 18 14:01:31.130732 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 15/28] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:01:31.143103 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-440b5ee8-4303-4df2-af7d-29fe35a4c827 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:31.166159 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-440b5ee8-4303-4df2-af7d-29fe35a4c827 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026615 Jul 18 14:01:31.166743 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 14/29] 10.222.0.94 () {64 vars in 1332 bytes} [Mon Jul 18 14:01:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:33.442929 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-8788204b-10f2-4dec-9c36-290f42316ee7 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:33.446711 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-8788204b-10f2-4dec-9c36-290f42316ee7 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004134 Jul 18 14:01:33.447207 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 16/30] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:33.959454 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-9d41c7b9-b170-4732-8a8a-2ca7110fe60f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "swap": 0}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:33.978936 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-9d41c7b9-b170-4732-8a8a-2ca7110fe60f admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.525405 Jul 18 14:01:33.980092 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 15/31] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:01:33.991885 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-93425a8e-75ed-4cb7-a95c-aa0c93238dfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:34.016250 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-93425a8e-75ed-4cb7-a95c-aa0c93238dfa admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028108 Jul 18 14:01:34.016864 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 17/32] 10.222.0.94 () {64 vars in 1332 bytes} [Mon Jul 18 14:01:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:01:36.238551 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-9d41c7b9-b170-4732-8a8a-2ca7110fe60f admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:36.240185 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-9d41c7b9-b170-4732-8a8a-2ca7110fe60f admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002265 Jul 18 14:01:36.241053 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 16/33] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:36.673954 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-5afd9326-22cb-47a5-81ec-abd6c49d91a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:36.692824 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-5afd9326-22cb-47a5-81ec-abd6c49d91a0 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.446387 Jul 18 14:01:36.693623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 18/34] 10.222.0.94 () {64 vars in 1282 bytes} [Mon Jul 18 14:01:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:01:36.705527 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-4d2e70f8-6c9f-4636-96b2-d3d00dde675b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:01:36.709274 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:36.730766 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-4d2e70f8-6c9f-4636-96b2-d3d00dde675b admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028986 Jul 18 14:01:36.731990 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 17/35] 10.222.0.94 () {64 vars in 1332 bytes} [Mon Jul 18 14:01:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:01:56.507810 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-5afd9326-22cb-47a5-81ec-abd6c49d91a0 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:56.508845 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-5afd9326-22cb-47a5-81ec-abd6c49d91a0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 14:01:56.509237 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 19/36] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:56.894640 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-8c924852-3405-4aae-930c-f2c70f08e3be admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:56.911649 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-8c924852-3405-4aae-930c-f2c70f08e3be admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395991 Jul 18 14:01:56.912212 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 18/37] 10.222.0.94 () {60 vars in 1291 bytes} [Mon Jul 18 14:01:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:01:57.970970 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-5afd9326-22cb-47a5-81ec-abd6c49d91a0 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:57.972027 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-5afd9326-22cb-47a5-81ec-abd6c49d91a0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 18 14:01:57.972422 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 20/38] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:01:58.484252 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-ce88384b-28df-44e0-89c4-72db544c6b4e admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:58.489732 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.wsgi [None req-ce88384b-28df-44e0-89c4-72db544c6b4e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-ce88384b-28df-44e0-89c4-72db544c6b4e admin admin] Request method failure captured: Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Accept: application/json Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Accept-Encoding: gzip, deflate Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Connection: keep-alive Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Content-Length: 0 Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Host: 10.222.0.94 Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Openstack-Api-Version: compute 2.90 Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Openstack-System-Scope: None Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: User-Agent: python-novaclient Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Auth-Token: gAAAAABi1WfVmbJqc0GwqV2zV-crigURBBECsg6Fd1lQm9pVhUNyXvmws_fRGXoDrobCJJY5o3ovXKqmv-TrLosL8goj6pdraI_pqH6ZcN0W252Xcs_9TwBgG3uTgq-JPDpiGoBBaVpupHGCMg5zmuAOdlnpLzQzsgFNkPgqaUaY3waQyWMb0ys Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Domain-Id: None Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Domain-Name: None Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Identity-Status: Confirmed Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Is-Admin-Project: True Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Domain-Id: default Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Domain-Name: Default Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Name: admin Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Role: admin,reader,member Jul 18 14:01:58.492937 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Roles: admin,reader,member Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/defeadff0f9c417facade99f9905fca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_defeadff0f9c417facade99f9905fca6"}]}] Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant: admin Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant-Name: admin Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User: admin Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Domain-Id: default Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Domain-Name: Default Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Id: 7a10bd46534e415080cc3fb7cb29bb4d Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Name: admin Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: method: > Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: exception: Flavor 42 could not be found. Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: action_args: {'id': '42'} Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:01:58.494593 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:01:58.495491 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.496719 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-ce88384b-28df-44e0-89c4-72db544c6b4e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:01:58.498459 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-ce88384b-28df-44e0-89c4-72db544c6b4e admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.384723 Jul 18 14:01:58.498459 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 19/39] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Jul 18 14:01:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:58.503982 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-c0cf8492-8aff-48ca-8098-a46c92c1bd2b admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:58.506962 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:58.526760 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-c0cf8492-8aff-48ca-8098-a46c92c1bd2b admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026272 Jul 18 14:01:58.527312 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 21/40] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Jul 18 14:01:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:01:58.536921 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-5f94c93c-b7b8-401c-8582-b56e928eead0 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:58.558072 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-5f94c93c-b7b8-401c-8582-b56e928eead0 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024648 Jul 18 14:01:58.558610 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 20/41] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Jul 18 14:01:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:01:58.568179 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-fb42546f-51f2-4a0b-864b-1e21d48fabe0 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:58.574381 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.wsgi [None req-fb42546f-51f2-4a0b-864b-1e21d48fabe0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-fb42546f-51f2-4a0b-864b-1e21d48fabe0 admin admin] Request method failure captured: Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Accept: application/json Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Accept-Encoding: gzip, deflate Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Connection: keep-alive Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Content-Length: 0 Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Host: 10.222.0.94 Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Openstack-Api-Version: compute 2.90 Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Openstack-System-Scope: None Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: User-Agent: python-novaclient Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Auth-Token: gAAAAABi1WfVmbJqc0GwqV2zV-crigURBBECsg6Fd1lQm9pVhUNyXvmws_fRGXoDrobCJJY5o3ovXKqmv-TrLosL8goj6pdraI_pqH6ZcN0W252Xcs_9TwBgG3uTgq-JPDpiGoBBaVpupHGCMg5zmuAOdlnpLzQzsgFNkPgqaUaY3waQyWMb0ys Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Domain-Id: None Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Domain-Name: None Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Identity-Status: Confirmed Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Is-Admin-Project: True Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Domain-Id: default Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Domain-Name: Default Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Name: admin Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Role: admin,reader,member Jul 18 14:01:58.577615 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Roles: admin,reader,member Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/defeadff0f9c417facade99f9905fca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_defeadff0f9c417facade99f9905fca6"}]}] Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant: admin Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant-Name: admin Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User: admin Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Domain-Id: default Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Domain-Name: Default Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Id: 7a10bd46534e415080cc3fb7cb29bb4d Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Name: admin Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: method: > Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: exception: Flavor 42 could not be found. Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: action_args: {'id': '42'} Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:01:58.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:01:58.580142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:01:58.581539 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-fb42546f-51f2-4a0b-864b-1e21d48fabe0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:01:58.582777 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-fb42546f-51f2-4a0b-864b-1e21d48fabe0 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014588 Jul 18 14:01:58.582777 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 22/42] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Jul 18 14:01:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:59.563704 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-5f94c93c-b7b8-401c-8582-b56e928eead0 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:01:59.564803 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-5f94c93c-b7b8-401c-8582-b56e928eead0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 18 14:01:59.565196 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 21/43] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:01:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:00.082784 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-034c2534-7b5e-4612-8188-6b2803355c14 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:00.088081 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.wsgi [None req-034c2534-7b5e-4612-8188-6b2803355c14 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-034c2534-7b5e-4612-8188-6b2803355c14 admin admin] Request method failure captured: Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Accept: application/json Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Accept-Encoding: gzip, deflate Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Connection: keep-alive Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Content-Length: 0 Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Host: 10.222.0.94 Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Openstack-Api-Version: compute 2.90 Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Openstack-System-Scope: None Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: User-Agent: python-novaclient Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Auth-Token: gAAAAABi1WfXZVqxf3cNK5bc_wySdBV1uOIaqa83vcnFEgITuaBQgYGxYiPKWl7uYLzJJ6qC7jgB1BoGRMD2hpmkdHTnKJzcGYeuuE51HvKnng5HEKeEZMzZzoEpZG-YKsLOjDCBPLh32NZMkUcv9o8fX1nzAnlrjzXgjRm79s9nsNjRbFPgugw Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Domain-Id: None Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Domain-Name: None Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Identity-Status: Confirmed Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Is-Admin-Project: True Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Domain-Id: default Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Domain-Name: Default Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Name: admin Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Role: admin,reader,member Jul 18 14:02:00.089578 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Roles: admin,reader,member Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/defeadff0f9c417facade99f9905fca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_defeadff0f9c417facade99f9905fca6"}]}] Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant: admin Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant-Name: admin Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User: admin Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Domain-Id: default Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Domain-Name: Default Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Id: 7a10bd46534e415080cc3fb7cb29bb4d Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Name: admin Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: method: > Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: exception: Flavor 84 could not be found. Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: action_args: {'id': '84'} Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:02:00.090895 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:00.091730 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.092938 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-034c2534-7b5e-4612-8188-6b2803355c14 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:02:00.093967 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-034c2534-7b5e-4612-8188-6b2803355c14 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388921 Jul 18 14:02:00.093967 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 23/44] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Jul 18 14:01:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:00.100465 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-158b06e9-ec64-4233-bbb1-6060b6f1a9da admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:00.113883 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-158b06e9-ec64-4233-bbb1-6060b6f1a9da admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016893 Jul 18 14:02:00.114342 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 22/45] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Jul 18 14:02:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:02:00.124032 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-fdb06c68-ec4e-40c3-9e0e-c5c99919636d admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:00.138009 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-fdb06c68-ec4e-40c3-9e0e-c5c99919636d admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017448 Jul 18 14:02:00.138523 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 24/46] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Jul 18 14:02:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:02:00.147297 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-0b0e60ef-e934-4d96-99e9-63f126e40473 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:00.152477 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.wsgi [None req-0b0e60ef-e934-4d96-99e9-63f126e40473 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-0b0e60ef-e934-4d96-99e9-63f126e40473 admin admin] Request method failure captured: Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Accept: application/json Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Accept-Encoding: gzip, deflate Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Connection: keep-alive Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Content-Length: 0 Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Host: 10.222.0.94 Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Openstack-Api-Version: compute 2.90 Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Openstack-System-Scope: None Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: User-Agent: python-novaclient Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Auth-Token: gAAAAABi1WfXZVqxf3cNK5bc_wySdBV1uOIaqa83vcnFEgITuaBQgYGxYiPKWl7uYLzJJ6qC7jgB1BoGRMD2hpmkdHTnKJzcGYeuuE51HvKnng5HEKeEZMzZzoEpZG-YKsLOjDCBPLh32NZMkUcv9o8fX1nzAnlrjzXgjRm79s9nsNjRbFPgugw Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Domain-Id: None Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Domain-Name: None Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Identity-Status: Confirmed Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Is-Admin-Project: True Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Domain-Id: default Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Domain-Name: Default Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Name: admin Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Role: admin,reader,member Jul 18 14:02:00.153968 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Roles: admin,reader,member Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/defeadff0f9c417facade99f9905fca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_defeadff0f9c417facade99f9905fca6"}]}] Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant: admin Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant-Name: admin Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User: admin Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Domain-Id: default Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Domain-Name: Default Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Id: 7a10bd46534e415080cc3fb7cb29bb4d Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Name: admin Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: method: > Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: exception: Flavor 84 could not be found. Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: action_args: {'id': '84'} Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:02:00.155699 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:00.156703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:00.158182 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-0b0e60ef-e934-4d96-99e9-63f126e40473 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:02:00.159441 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-0b0e60ef-e934-4d96-99e9-63f126e40473 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011472 Jul 18 14:02:00.159441 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 23/47] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Jul 18 14:02:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 14:02:01.114379 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-fdb06c68-ec4e-40c3-9e0e-c5c99919636d admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:01.115425 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-fdb06c68-ec4e-40c3-9e0e-c5c99919636d admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 18 14:02:01.115813 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 25/48] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:02:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:01.634676 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-05cf377a-7ef8-4084-90f9-214f8b892d56 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:01.640628 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.wsgi [None req-05cf377a-7ef8-4084-90f9-214f8b892d56 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-05cf377a-7ef8-4084-90f9-214f8b892d56 admin admin] Request method failure captured: Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Accept: application/json Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Accept-Encoding: gzip, deflate Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Connection: keep-alive Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Content-Length: 0 Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Host: 10.222.0.94 Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Openstack-Api-Version: compute 2.90 Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Openstack-System-Scope: None Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: User-Agent: python-novaclient Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Auth-Token: gAAAAABi1WfZ9H4tmnA2IgtQ-evlQ0SnWChBBeY-Qk7uqXOrwKm4MPPxRxFRtmyP5MT4JC0tPqQbGF3uMhNUpD8wmDVu__BLujqRShYrR2iQyz70C_Wc56ICAE8VR8ZL_S3LpJWacHtTer0Gc1fKKmw88ctzgr_PCxZNNk80LCnhMufK-boef_o Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Domain-Id: None Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Domain-Name: None Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Identity-Status: Confirmed Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Is-Admin-Project: True Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Domain-Id: default Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Domain-Name: Default Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Project-Name: admin Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Role: admin,reader,member Jul 18 14:02:01.642124 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Roles: admin,reader,member Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/defeadff0f9c417facade99f9905fca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_defeadff0f9c417facade99f9905fca6"}]}] Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant: admin Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-Tenant-Name: admin Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User: admin Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Domain-Id: default Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Domain-Name: Default Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Id: 7a10bd46534e415080cc3fb7cb29bb4d Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: X-User-Name: admin Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: method: > Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: exception: Flavor 451 could not be found. Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: action_args: {'id': '451'} Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:02:01.643789 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:01.644809 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.646122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-05cf377a-7ef8-4084-90f9-214f8b892d56 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:02:01.647364 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-05cf377a-7ef8-4084-90f9-214f8b892d56 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389912 Jul 18 14:02:01.647364 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 24/49] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Jul 18 14:02:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:01.653554 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-e95548a9-0705-46de-b665-ede62ee9c9dd admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:01.668198 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-e95548a9-0705-46de-b665-ede62ee9c9dd admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018621 Jul 18 14:02:01.668722 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 26/50] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Jul 18 14:02:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:02:01.678153 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:01.693090 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018479 Jul 18 14:02:01.693609 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 25/51] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Jul 18 14:02:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:02:01.702628 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-a575d34e-c047-4282-b7a7-ead155a31b5f admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:01.707899 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.wsgi [None req-a575d34e-c047-4282-b7a7-ead155a31b5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-a575d34e-c047-4282-b7a7-ead155a31b5f admin admin] Request method failure captured: Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Accept: application/json Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Accept-Encoding: gzip, deflate Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Connection: keep-alive Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Content-Length: 0 Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Host: 10.222.0.94 Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Openstack-Api-Version: compute 2.90 Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Openstack-System-Scope: None Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: User-Agent: python-novaclient Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Auth-Token: gAAAAABi1WfZ9H4tmnA2IgtQ-evlQ0SnWChBBeY-Qk7uqXOrwKm4MPPxRxFRtmyP5MT4JC0tPqQbGF3uMhNUpD8wmDVu__BLujqRShYrR2iQyz70C_Wc56ICAE8VR8ZL_S3LpJWacHtTer0Gc1fKKmw88ctzgr_PCxZNNk80LCnhMufK-boef_o Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Domain-Id: None Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Domain-Name: None Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Identity-Status: Confirmed Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Is-Admin-Project: True Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Domain-Id: default Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Domain-Name: Default Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Project-Name: admin Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Role: admin,reader,member Jul 18 14:02:01.709438 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Roles: admin,reader,member Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/defeadff0f9c417facade99f9905fca6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/defeadff0f9c417facade99f9905fca6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_defeadff0f9c417facade99f9905fca6"}]}] Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant: admin Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant-Id: defeadff0f9c417facade99f9905fca6 Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-Tenant-Name: admin Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User: admin Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Domain-Id: default Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Domain-Name: Default Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Id: 7a10bd46534e415080cc3fb7cb29bb4d Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: X-User-Name: admin Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: method: > Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: exception: Flavor 451 could not be found. Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: action_args: {'id': '451'} Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:02:01.711001 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:01.711968 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: ERROR nova.api.openstack.wsgi Jul 18 14:02:01.713623 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-a575d34e-c047-4282-b7a7-ead155a31b5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:02:01.714704 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-a575d34e-c047-4282-b7a7-ead155a31b5f admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011657 Jul 18 14:02:01.714704 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 27/52] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Jul 18 14:02:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:02.674965 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:02.675988 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 18 14:02:02.676411 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 26/53] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:03.195388 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-45fbfdb6-73b9-4bc3-8b64-b1fe28b33d5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:03.214333 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-45fbfdb6-73b9-4bc3-8b64-b1fe28b33d5a admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.399877 Jul 18 14:02:03.214865 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 28/54] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Jul 18 14:02:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:02:04.161703 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:04.162701 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 18 14:02:04.163122 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 27/55] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:02:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:04.685270 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-bcaa9cc7-5b96-4990-9e5b-a43a8eb5d13b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:04.702857 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-bcaa9cc7-5b96-4990-9e5b-a43a8eb5d13b admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404628 Jul 18 14:02:04.703393 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 29/56] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Jul 18 14:02:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:02:05.668691 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:05.669690 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 18 14:02:05.670077 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 28/57] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:02:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:06.187251 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-d37ef6fc-2202-4a9d-a499-864724c288e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:06.204613 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-d37ef6fc-2202-4a9d-a499-864724c288e5 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398480 Jul 18 14:02:06.205403 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 30/58] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Jul 18 14:02:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:02:07.176154 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:07.177165 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 18 14:02:07.177562 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 29/59] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:02:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:07.714077 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-9dbe5477-c51f-43ba-85bd-75a0de77cd9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:02:07.732070 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-9dbe5477-c51f-43ba-85bd-75a0de77cd9f admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.416529 Jul 18 14:02:07.732603 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 31/60] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Jul 18 14:02:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:02:08.689810 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:08.690818 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 18 14:02:08.691211 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 30/61] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:02:09.212421 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-08f8ab45-8cb9-4738-ad3b-688711ed107d admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:02:09.233035 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-08f8ab45-8cb9-4738-ad3b-688711ed107d admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405247 Jul 18 14:02:09.233569 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 32/62] 10.222.0.94 () {60 vars in 1202 bytes} [Mon Jul 18 14:02:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:03:00.290347 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:00.291350 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-c3d7270f-c576-4533-981d-2c9d6ff6f20a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 18 14:03:00.291750 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 31/63] 10.222.0.94 () {54 vars in 930 bytes} [Mon Jul 18 14:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:03:00.302225 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:00.803407 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-c5654f7d-71b1-4590-a5a0-c451e43f4a99 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:00.823840 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-c5654f7d-71b1-4590-a5a0-c451e43f4a99 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.526218 Jul 18 14:03:00.824423 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 33/64] 10.222.0.94 () {60 vars in 1291 bytes} [Mon Jul 18 14:03:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:03:00.846950 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-983acb85-21ed-4d72-b991-1e2961c12b84 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:00.850279 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG dbcounter [-] [103324] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:00.856018 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-983acb85-21ed-4d72-b991-1e2961c12b84 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012652 Jul 18 14:03:00.856525 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 32/65] 10.222.0.94 () {60 vars in 1282 bytes} [Mon Jul 18 14:03:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:00.867672 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-71be98c7-121f-4d77-ae38-a97d291b91d1 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:00.875781 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-71be98c7-121f-4d77-ae38-a97d291b91d1 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011643 Jul 18 14:03:00.876333 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 34/66] 10.222.0.94 () {60 vars in 1285 bytes} [Mon Jul 18 14:03:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:00.887138 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:00.894956 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011288 Jul 18 14:03:00.895459 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 33/67] 10.222.0.94 () {60 vars in 1285 bytes} [Mon Jul 18 14:03:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:00.906663 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-cd4cfdd3-7e1e-4d27-9035-8a227ce8170f admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:03:00.914022 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-cd4cfdd3-7e1e-4d27-9035-8a227ce8170f admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010761 Jul 18 14:03:00.914511 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 35/68] 10.222.0.94 () {60 vars in 1282 bytes} [Mon Jul 18 14:03:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:06:25.854832 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:25.855828 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 18 14:06:25.856269 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 34/69] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:06:25.994947 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_api:SELECT=6 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:26.152943 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-b80e9555-1698-46b4-b785-f899b91e7449 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:26.154142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:06:26.154142 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: warnings.warn(msg) Jul 18 14:06:26.155373 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-b80e9555-1698-46b4-b785-f899b91e7449 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:26.155819 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-b80e9555-1698-46b4-b785-f899b91e7449 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:26.156649 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-b80e9555-1698-46b4-b785-f899b91e7449 admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:26.157082 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-b80e9555-1698-46b4-b785-f899b91e7449 admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:26.191232 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-b80e9555-1698-46b4-b785-f899b91e7449 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197655 Jul 18 14:06:26.191781 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 36/70] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Jul 18 14:06:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:06:27.008293 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:27.009300 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 18 14:06:27.009700 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 35/71] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:06:27.200335 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-6fb7d3f8-4b6a-48ec-8046-db68d2f2a794 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:27.201503 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:06:27.201503 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: warnings.warn(msg) Jul 18 14:06:27.203172 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3f8-4b6a-48ec-8046-db68d2f2a794 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:27.203611 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3f8-4b6a-48ec-8046-db68d2f2a794 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:27.204426 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3f8-4b6a-48ec-8046-db68d2f2a794 admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:27.204853 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3f8-4b6a-48ec-8046-db68d2f2a794 admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:27.224456 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-6fb7d3f8-4b6a-48ec-8046-db68d2f2a794 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075269 Jul 18 14:06:27.224992 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 37/72] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Jul 18 14:06:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:06:38.454423 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:38.455419 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 18 14:06:38.455811 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 36/73] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:06:38.599368 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_cell0:SELECT=4 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:38.600104 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_cell1:SELECT=4 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:38.600781 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG dbcounter [-] [103323] Writing DB stats nova_api:SELECT=8 {{(pid=103323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:38.648851 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-821dc6c8-457c-48ad-a15a-181bce684f3a admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:38.650051 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:06:38.650051 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: warnings.warn(msg) Jul 18 14:06:38.651230 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-821dc6c8-457c-48ad-a15a-181bce684f3a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:38.651697 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-821dc6c8-457c-48ad-a15a-181bce684f3a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:38.652491 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-821dc6c8-457c-48ad-a15a-181bce684f3a admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:38.652919 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-821dc6c8-457c-48ad-a15a-181bce684f3a admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:38.678473 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-821dc6c8-457c-48ad-a15a-181bce684f3a admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083499 Jul 18 14:06:38.678964 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 38/74] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Jul 18 14:06:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:06:39.534001 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: DEBUG nova.api.openstack.wsgi [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] Calling method '>' {{(pid=103324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:39.534992 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: INFO nova.api.openstack.requestlog [None req-13b8ab9c-ff7e-419f-9df6-a71675584cb5 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Jul 18 14:06:39.535383 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: [pid: 103324|app: 0|req: 37/75] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Jul 18 14:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:06:39.723501 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG nova.api.openstack.wsgi [None req-4fa11ee9-0eb0-4479-a992-be8ee269a345 admin admin] Calling method '>' {{(pid=103323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:06:39.724697 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:06:39.724697 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: warnings.warn(msg) Jul 18 14:06:39.725866 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-4fa11ee9-0eb0-4479-a992-be8ee269a345 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:39.726307 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-4fa11ee9-0eb0-4479-a992-be8ee269a345 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:39.727108 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-4fa11ee9-0eb0-4479-a992-be8ee269a345 admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:06:39.727537 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: DEBUG oslo_concurrency.lockutils [None req-4fa11ee9-0eb0-4479-a992-be8ee269a345 admin admin] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:06:39.749299 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: INFO nova.api.openstack.requestlog [None req-4fa11ee9-0eb0-4479-a992-be8ee269a345 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077104 Jul 18 14:06:39.749837 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: [pid: 103323|app: 0|req: 39/76] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Jul 18 14:06:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:07:37.364674 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: Mon Jul 18 14:07:37 2022 - graceful shutdown triggered... Jul 18 14:07:37.365201 dv-cinder-849846-1-iscsi devstack@n-api.service[103323]: Gracefully killing worker 1 (pid: 103323)... Jul 18 14:07:37.365637 dv-cinder-849846-1-iscsi devstack@n-api.service[103324]: Gracefully killing worker 2 (pid: 103324)... Jul 18 14:07:37.366737 dv-cinder-849846-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 14:07:38.365801 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: worker 1 buried after 1 seconds Jul 18 14:07:38.365801 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: worker 2 buried after 1 seconds Jul 18 14:07:38.365801 dv-cinder-849846-1-iscsi devstack@n-api.service[103322]: goodbye to uWSGI. Jul 18 14:07:38.367297 dv-cinder-849846-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 14:07:38.367861 dv-cinder-849846-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 14:07:38.370670 dv-cinder-849846-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 14:07:38.380719 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 14:07:38 2022] *** Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: nodename: dv-cinder-849846-1-iscsi Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: machine: x86_64 Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: clock source: unix Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: pcre jit disabled Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: detected number of CPU cores: 4 Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: current working directory: / Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: detected binary path: /usr/bin/uwsgi-core Jul 18 14:07:38.382718 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: your processes number limit is 47680 Jul 18 14:07:38.383424 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: your memory page size is 4096 bytes Jul 18 14:07:38.383424 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: detected max file descriptor number: 2048 Jul 18 14:07:38.383424 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: lock engine: pthread robust mutexes Jul 18 14:07:38.383424 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: thunder lock: enabled Jul 18 14:07:38.383424 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 14:07:38.383424 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 14:07:38.424861 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: Python main interpreter initialized at 0x55c87b9d19c0 Jul 18 14:07:38.424861 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: python threads support enabled Jul 18 14:07:38.424861 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: your server socket listen backlog is limited to 100 connections Jul 18 14:07:38.424861 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: your mercy for graceful operations on workers is 90 seconds Jul 18 14:07:38.425319 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 14:07:38.425319 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: *** Operational MODE: preforking *** Jul 18 14:07:38.425577 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: *** uWSGI is running in multiple interpreter mode *** Jul 18 14:07:38.425577 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: spawned uWSGI master process (pid: 117833) Jul 18 14:07:38.425782 dv-cinder-849846-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 14:07:38.430073 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: spawned uWSGI worker 1 (pid: 117845, cores: 1) Jul 18 14:07:38.430073 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: spawned uWSGI worker 2 (pid: 117846, cores: 1) Jul 18 14:07:38.430073 dv-cinder-849846-1-iscsi devstack@n-api.service[117833]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 14:07:39.085543 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 14:07:39.086353 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 14:07:40.241444 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:07:40.241444 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: from cryptography.utils import int_from_bytes Jul 18 14:07:40.242075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:07:40.242075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: from cryptography.utils import int_from_bytes Jul 18 14:07:40.247508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:07:40.247508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: from cryptography.utils import int_from_bytes Jul 18 14:07:40.247971 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:07:40.247971 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: from cryptography.utils import int_from_bytes Jul 18 14:07:42.540035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:07:42.540587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:07:42.540818 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:07:42.541181 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:07:42.541442 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:07:42.541827 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.542152 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.542474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.542794 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.543119 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.543429 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.543749 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.544651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.544982 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.545245 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.545560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.545882 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-1-iscsi {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.546202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.546508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.546836 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.547137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.547438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.547758 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.548091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.548590 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.549037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.549352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.549663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.550001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.551786 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.551786 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.551786 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.551786 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.551786 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.552359 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.552359 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-1-iscsi {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.552597 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.552874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.553179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.553598 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.553872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:07:42.554306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.554410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:07:42.554500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.554500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.554699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:07:42.554799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.555007 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:07:42.555139 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.555309 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:07:42.555425 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.555656 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.555772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.556015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.556128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.556341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.556452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.556646 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.556747 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.556956 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.557051 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.557263 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.557358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.557582 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.557684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.557916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.558024 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.558190 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.558285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.558443 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.558536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.558748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.558847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.559069 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.559174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-1-iscsi {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.559392 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.559496 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.560399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.560521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.560614 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.560698 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.560778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.560918 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.561094 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.561202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.561415 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.561538 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.561726 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.561853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.562035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.562319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.562463 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.562632 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.562750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.562936 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.563063 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.563244 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.563370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.563551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.563687 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.563863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.564034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.564204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.564337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.564522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.564653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.564832 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.564990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.565140 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.565272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.565464 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.565590 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.565858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.565995 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-1-iscsi {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.566141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.566268 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.566445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.566622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.566771 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.566905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.567036 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.567179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.567319 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.567467 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.567667 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.567820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.568438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.568607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.568760 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.568915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.569060 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.569203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.569344 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.569494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.569646 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.569791 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.570051 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.570211 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.570356 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.570505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.570665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.570881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.571034 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.571178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.571372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.571524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.571680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.571831 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.572016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.572177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.572405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.572563 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.572823 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.572970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.573121 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.573265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.573415 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.573572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.573724 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.573874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.574105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.574274 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.574433 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.574590 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.574744 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.574886 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.575067 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.575810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.576023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.576193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.576340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.576530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.576691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.577420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.577595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.577595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.577881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.578024 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.578175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.578349 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.578549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.578708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.578860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.579012 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.579203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.579373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.579526 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.579669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.579822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.580095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.580341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.580499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.580499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.580788 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.580931 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.581083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.581226 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.581370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.581531 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.581689 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.581914 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.582069 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.582220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.582370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.582522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.582664 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.582822 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.582976 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.583126 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.583269 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.583418 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.583573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.583728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.583872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.584037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.584279 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.584428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.584572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.584727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.584886 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.585035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.585186 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.585339 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.585491 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.585646 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.585789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.585937 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.586080 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.586228 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.586386 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.586529 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.586672 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.586821 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.586965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.587112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.587273 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.587418 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.587578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.587729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.587881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.588102 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.588257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.588409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.588552 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.588693 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.588844 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.588999 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.589143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.589143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.589431 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.589583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.589733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.589886 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.590037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.590180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.590346 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.590504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.590654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.590812 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.591019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.591191 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.591336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.591489 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.591631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.591783 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.591936 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.592116 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.592269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.592413 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.592565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.592716 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.592865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.593024 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.593174 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.593324 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.593488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.593639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.593782 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.593933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.594084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.594243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.594466 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.594616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.594766 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.594924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.595076 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.595219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.595378 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.595524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.595673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.595830 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.595992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.596155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.596299 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.596441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.596583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.596738 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.596882 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.597032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.597183 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.597366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.597519 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.597663 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.597812 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.597956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.598105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.598257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.598413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.598565 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.598716 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.598858 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.599007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.599156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.599325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.599486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.599638 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.599782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.599782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.600122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.600275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.600428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.600579 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.600728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.600871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.601023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.601167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:07:42.601333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.601477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.601659 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.601659 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.601935 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.602087 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.602275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.602430 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.602581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.602731 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.602883 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.603038 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.603199 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.603350 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.603502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.603653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.603797 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.603972 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.604135 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.604279 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.604438 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.604663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.604812 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.604965 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.605108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.605261 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.605405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.605547 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.605698 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.605849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.605993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.606142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.606293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.606436 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.607095 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.607258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.607404 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.607546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.607704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.607847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.608126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.608279 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.608423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.608572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.608716 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.608858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.608858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.609144 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.609286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.609429 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.609590 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.609744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.609899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.610050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.610195 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.610344 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.610562 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.610718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.610871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.611022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.611170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.611320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.611463 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.611623 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.611767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.611910 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.612079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.612234 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.612377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.612529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.612681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.612827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.612975 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.613131 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.613288 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.613441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.613601 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.613745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.613888 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.614037 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.614194 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.614345 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.614488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.614488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.614863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.615012 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.615164 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.615315 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.615477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.615621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.615777 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.615928 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.616108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.616258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.616402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.616551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.616693 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.616848 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.616992 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.617152 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.617300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.617452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.617607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.617758 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.617902 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.618052 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.618206 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.618350 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.618493 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.618644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.618801 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.618945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.619087 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.619229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.619382 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.619534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.619686 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.619829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.620016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.620177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.620331 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.620482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.620626 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.620768 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.620917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.621060 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.621215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.621377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.621528 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.621678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.621829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.621972 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.622123 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.622859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.623013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.623157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.623299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.623449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.623607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.623761 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.623916 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.624094 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.624247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.624399 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.624555 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.624555 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.624860 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.624860 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.625224 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.625224 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.625518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.625678 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.625846 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.625997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.626146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.626303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.626462 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.626462 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.626768 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.626768 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.627056 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.627226 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.627381 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.627539 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.627695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.627862 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.628061 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.628231 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.628390 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.628547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.628698 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.628698 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629003 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629317 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629625 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629774 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629946 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.629946 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.630246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.630395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.630543 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.630700 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.630862 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.631013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.631160 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.631308 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.631456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.631612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.631772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.631933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.632108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.632268 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.632424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.632588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.632738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.632895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.633051 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.633247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.633411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.633576 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.633726 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.633897 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.634093 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.634251 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.634412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.634571 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.634722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.634879 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.635051 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.635276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.635440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.635604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.635754 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.635905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.636129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.636129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.636439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.636589 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.636737 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.636892 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.637043 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.637198 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.637428 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.637580 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.637754 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.637909 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.638074 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.638236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.638399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.638549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.638705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.638855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.639010 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.639161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.639318 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.639476 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.639633 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.639790 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.639954 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.640113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.640290 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.640441 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.640598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.640747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.640896 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.641053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.641204 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.641360 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.641517 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.641666 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.641814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.641974 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.642125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.642284 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.642433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.642590 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.642740 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.642897 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.643047 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.643202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.643360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.643509 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.643665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.643826 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.644038 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.644217 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.644377 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.644533 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.644697 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.644855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.645013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.645169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.645418 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.645575 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.645738 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.645896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.646052 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.646210 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.646370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.646520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.646682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.646833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.646981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.647130 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.647296 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.647449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.647608 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.647757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.647914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.648088 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.648248 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.648423 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.648583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.648740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.648889 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.649045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.649195 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.649356 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.649507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.649664 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.649814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.649962 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.650118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.650118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.650434 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.650586 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.650734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.650882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.651038 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.651197 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.651354 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.651504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.651661 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.651818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.652013 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.652178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.652340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.652489 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.652637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.652793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.652952 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.653110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.653269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.653452 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.653613 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.653765 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.653921 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.654071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.654219 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.654387 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.654538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.654694 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.654852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.655009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.655165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.655329 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.655594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.655762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.655921 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.656118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.656270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.656451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.656625 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.656784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.656935 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.657086 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.657250 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.657250 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.657555 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.657711 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.657871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.658023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.658185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.658336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.658492 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.658653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.658803 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.658952 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.659116 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.659274 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.659431 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.659580 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.659737 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.659887 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.660102 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.660256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.660406 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.660562 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.660731 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.660888 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.661092 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.661246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.661395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.661551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.661701 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.661863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.662022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.662172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.662321 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.662470 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.662632 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.662798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.662948 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.663106 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.663259 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.663415 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.663573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.663736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.663893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.664066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.664219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.664379 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.664544 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.664704 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.664704 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.665005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.665157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.665314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.665473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.665718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.665876 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.666033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.666182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.666424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.666608 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.666763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.666925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.667083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.667248 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.667405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.667567 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.667718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.667874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.668170 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.668332 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.668492 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.668643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.668793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.668987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.669662 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.669814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.669964 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.670121 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.670271 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.670421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.670585 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.670735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.670893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.671050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.671050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.671336 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.671509 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.671668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.671825 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.671993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.672149 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.672315 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.672315 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.672609 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.672760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.672910 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.672910 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.673214 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.673365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.673535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.673694 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.673850 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.674000 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.674159 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.674309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.674466 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.674624 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.674783 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.674933 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.675161 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.675313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.675488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.675661 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.675902 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.676220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.676375 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.676532 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.676691 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.676843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.676843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.677140 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.677310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.677462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.677619 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.677780 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.677930 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.678090 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.678241 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.678397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.678554 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.678711 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.678870 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.679029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.679186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.679337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.679493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.679644 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.679811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.679982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.680152 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.680305 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.680461 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.680612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.680775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.680926 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.681075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.681224 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.681381 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.681537 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.681696 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.681864 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.682015 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.682166 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.682166 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.682456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.682456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.682756 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.682911 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.683068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.683068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.683374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.683525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.683674 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.683841 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.684066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.684219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.684385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.684572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.684784 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.685459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.685609 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.685758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.685944 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.686168 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.686325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.686475 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.686644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.686801 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.686965 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.687124 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.687282 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.687436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.687585 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.687744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.687894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.688069 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.688220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.688370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.688534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.688695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.688846 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.688996 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.689145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.689294 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.689451 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.689616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.689767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.689917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.690066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.690215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.690372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.690543 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.690701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.690853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.691009 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.691170 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.691328 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.691649 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.691821 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.692021 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.692188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.692341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.692504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.692671 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.692841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.693263 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.693418 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.693569 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.693732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.693891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.694048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.694200 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.694349 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.694499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.694657 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.694816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.694973 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.695141 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.695291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.695450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.695450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.695738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.695888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.696091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.696341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.696547 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.696705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.696856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.696856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.697175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.697338 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.697503 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.697654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.697813 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.697963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.698113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.698269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.698430 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.698430 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.698735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.698887 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.699044 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.699044 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.699352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.699508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.699660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.699809 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.699978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.700254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.700424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.700576 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.700733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.700892 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.701052 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.701215 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.701377 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.701527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.701684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.701842 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702323 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702963 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.702963 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.703258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.703427 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.703579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.703728 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.703891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.704111 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.704273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.704433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.704592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.704744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.704903 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.705063 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.705214 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.705375 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.705525 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.705681 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.705914 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.706068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.706221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.706458 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.706624 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.706786 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.706945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.707096 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.707262 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.707426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.707589 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.707753 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.707912 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.708100 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.708254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.708412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.708569 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.708770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.708931 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.709083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.709232 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.709390 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.709549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.709724 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.709876 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.710034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.710224 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.710389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.710549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.710708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.710859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.711008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.711157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.711307 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.711472 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.711624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.711784 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.711934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.712128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.712279 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.712445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.712598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.712755 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.712905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.713054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.713203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.713366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.713525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.713689 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.713849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.714014 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.714172 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.714331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.714488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.714648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.714798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.714958 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.715117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.715268 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.715418 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.715567 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.715736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.715933 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.716120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.716280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.716456 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.716681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.716847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.716998 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.717158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.717320 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.717481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.717632 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.717791 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.717960 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.718119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.718276 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.718276 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.718570 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.718730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.718882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.719040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.719191 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.719348 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.719500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.719658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.719821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.720000 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.720158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.720315 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.720480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.720638 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.720789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.720939 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.721089 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.721246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.721410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.721573 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.721732 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.721897 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.722058 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.722216 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.722380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.722538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.722696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.722853 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.723005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.723154 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.723316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.723473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.723625 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.723774 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.723934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.724126 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.724288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.724446 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.724598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.724754 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.724905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.725064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.725064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.725360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.725519 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.725669 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.725818 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.725988 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.726140 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.726289 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.726438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.726588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.726841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.726999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.727150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.727319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.727471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.727629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.727860 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.728048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.728204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.728355 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.728504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.728665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.728825 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.728977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.729134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.729285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.729285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.729576 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.729736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.729887 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.730047 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.730197 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.730348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.730511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.730708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.730872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.731031 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.731264 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.731422 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.732179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.732342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.732494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.732645 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.732814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.732973 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.733133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.733284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.733443 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.733594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.733772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.733938 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.734098 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.734250 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.734399 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.734558 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.734742 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.734906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.735066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.735219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.735219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.735512 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.735512 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.735814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.735991 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.736178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.736332 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.736484 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.736644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.736984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.737147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.737320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.737482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.737648 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.737902 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.738193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.738452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.738721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.738962 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.739203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.739429 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.739587 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.739761 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.739915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.740135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.740300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.740465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.740626 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.740809 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.740962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.741112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.741263 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.741426 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.741578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.741739 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.741890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.742081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.742253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.742404 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.742564 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.742722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.742873 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743187 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.743369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.744602 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.744602 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.744602 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.744602 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.745188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.745339 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.745499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.745657 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.745856 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746491 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.746648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.747903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.748091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.748267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.748420 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.748578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.748737 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.748888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.749047 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.749209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.749370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.749530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.749688 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.749840 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.749990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.750149 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.750316 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.750316 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.750611 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.750762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.750919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.751079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.751232 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.751382 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.751532 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.751688 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.751853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.752108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.752272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.752272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.752622 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.752777 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.752942 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.753094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.753243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.753395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.753545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.753695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.753859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.753859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.754155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.754323 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.754476 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.754634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.754795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.754946 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.754946 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.755231 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.755381 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.755546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.755706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.755858 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.756062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.756215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.756375 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.756544 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.756695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.756852 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.757003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.757172 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.757406 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.757574 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.757726 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.757726 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.758019 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.758170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.758328 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.758500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.758653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.758803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.758953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.759112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.759349 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.759503 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.759655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.759805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.759981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.760146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.760312 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.760483 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.760635 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.760789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.760789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.761093 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.761246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.761396 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.761544 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.761701 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.761853 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.762011 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.762168 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.762349 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.762509 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.762660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.762843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.763009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.763160 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.763311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.763521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.763686 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.763839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.764027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.764186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.764336 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.764497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.764658 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.764818 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.764971 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765127 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765286 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765444 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.765763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.766991 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.767139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.767297 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.767565 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.767724 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.767881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.768079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.768242 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.768393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.768393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.768393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.771256 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.771413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.771413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.771413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.771855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.772083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.772253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.772408 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.772567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.772726 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.772909 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773068 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773286 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773462 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.773775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.774341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.774491 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.774655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.774807 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.774976 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.775128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.775278 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.775429 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.775588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.775739 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.775889 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.776066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.776066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.776066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.776511 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.776670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.776828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.776995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.777147 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.777313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.777313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.777703 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.777703 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.778004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.778004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.778299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.778491 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.778655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.778806 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.778806 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.779121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.779280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.779432 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.779582 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.779740 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.779905 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.780148 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.780302 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.780460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.780612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.780762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.780922 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.781081 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.781240 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.781398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.781556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.781715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.781865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.782025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.782184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.782346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.782497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.782647 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.782834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.782998 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.783148 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.783148 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.783451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.783609 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.783769 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.783934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.784113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.784263 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.784412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.784561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.784722 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.784875 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.785036 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.785194 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.785346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.785495 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.785653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.785805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.785956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.786105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.786105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.786411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.786563 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.786721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.786890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.787041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.787190 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.787349 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.787508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.787686 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.787917 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.788118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.788278 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.788445 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.788604 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.788761 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.788912 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.789081 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.789243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.789403 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.789553 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.789710 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.789871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.790029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.790029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.790333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.790486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.790636 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.790785 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.790942 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.791189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.791351 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.791510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.791661 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.791811 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.791980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.792155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.792318 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.792477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.792629 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.792778 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.792928 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.793093 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.793256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.793256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.793256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.793683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.793842 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.794522 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.794683 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.794843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.795004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.795004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.795306 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.795465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.795627 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.795777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.795935 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.796122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.796282 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.796434 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.796584 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.796733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.796891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.797042 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.797201 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.797354 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.797504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.797672 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.797824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.798070 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.798237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.798389 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.798547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.798699 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.798848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.799086 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.799243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.799394 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.799553 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.799714 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.799864 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.800089 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.800253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.800412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.800572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.800731 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.800895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.801054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.801204 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.801363 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.801363 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.801681 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.801842 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.801992 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.802142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.802304 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.802463 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.802616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.802778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.802931 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.803081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.803239 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.803397 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.803397 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.803718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.803870 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.804054 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.804208 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.804366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.804526 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.804677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.804834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.804985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117845) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.805919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.807082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.808441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.809679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.809679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.809679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.809679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.809679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.809679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.809679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.810684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.810684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.810684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.811112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.811112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.811423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.811624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.811926 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.812254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.812556 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.812891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.813223 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.813542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.813866 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.814183 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.814503 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.814899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.815576 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.815906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.816281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.816598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.816936 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.817461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.817780 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.818354 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.818665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.818980 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.819426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.819770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.820124 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.820434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.820763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.821085 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.821412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.821730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.822043 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.822373 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.822683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.822996 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.831986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.833420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.834578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.834578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.834578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.834578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:07:42.835595 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117846) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:07:42.952161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO dbcounter [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Registered counter for database nova_api Jul 18 14:07:42.972555 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_db.sqlalchemy.engines [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:42.978978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writer thread running {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:42.991523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Registered counter for database nova_api Jul 18 14:07:43.011604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:43.018856 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:43.036407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.context [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9(cell1) {{(pid=117845) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 14:07:43.040385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:43.041972 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:43.042782 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:43.044834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:43.046819 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO dbcounter [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Registered counter for database nova_cell0 Jul 18 14:07:43.050880 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO dbcounter [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Registered counter for database nova_cell1 Jul 18 14:07:43.058008 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_db.sqlalchemy.engines [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:43.060818 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_db.sqlalchemy.engines [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:43.066278 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writer thread running {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:43.068803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writer thread running {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:43.076179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.context [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9(cell1) {{(pid=117846) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 14:07:43.080144 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:43.081711 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:43.082504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:07:43.084487 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:07:43.086460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Registered counter for database nova_cell0 Jul 18 14:07:43.090502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Registered counter for database nova_cell1 Jul 18 14:07:43.098040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:43.099816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:43.105269 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:43.107978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:43.214734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO dbcounter [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Registered counter for database nova_cell0 Jul 18 14:07:43.221948 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_db.sqlalchemy.engines [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117845) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:43.226708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writer thread running {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:43.253436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO dbcounter [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Registered counter for database nova_cell0 Jul 18 14:07:43.261499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_db.sqlalchemy.engines [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117846) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:07:43.266176 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writer thread running {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:07:43.543419 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: WARNING keystonemiddleware.auth_token [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:07:43.551643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: WARNING keystonemiddleware.auth_token [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:07:43.583296 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:07:43.590643 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:07:43.895724 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: WARNING keystonemiddleware.auth_token [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:07:43.901725 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: WARNING keystonemiddleware.auth_token [None req-ab52784a-37ed-46ae-b6ab-5eead267bb1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:07:43.907691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c87b9d19c0 pid: 117845 (default app) Jul 18 14:07:43.937807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:07:43.946758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: WARNING keystonemiddleware.auth_token [None req-ef318264-8e0a-4173-a611-0f58b9f0ad97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:07:43.949567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c87b9d19c0 pid: 117846 (default app) Jul 18 14:08:25.132720 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.136518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.137594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.138760 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.159684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.162891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.166162 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.171287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:26.496309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-11399990-60a0-41f3-9ebc-60f16baab6c5 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Action: 'create', calling method: .version_select at 0x7f7b412d3940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-292053510", "metadata": {"Type": "work"}}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:26.616814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c27f970b-8409-4d88-b832-e51e7618ebc9 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Action: 'create', calling method: .version_select at 0x7f7b412d58b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-317963184"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:28.108291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-11399990-60a0-41f3-9ebc-60f16baab6c5 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.993496 Jul 18 14:08:28.110919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 1/1] 10.222.0.94 () {60 vars in 1155 bytes} [Mon Jul 18 14:08:25 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2998 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 14:08:28.125863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d443d630-9b8b-49b4-8d8e-b71fd2ed08c3 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Calling method '.version_select at 0x7f7b4119d790>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:28.233117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c27f970b-8409-4d88-b832-e51e7618ebc9 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.080610 Jul 18 14:08:28.234747 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 1/2] 10.222.0.94 () {60 vars in 1154 bytes} [Mon Jul 18 14:08:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3084 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 14:08:28.247253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d5d01717-d3ad-44f3-9daa-fd33a208bfa3 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b4119f700>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:28.324529 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d443d630-9b8b-49b4-8d8e-b71fd2ed08c3 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3" status: 200 len: 352 microversion: 2.1 time: 0.205147 Jul 18 14:08:28.326307 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 2/3] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:28 2022] GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 => generated 352 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:08:28.461498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d5d01717-d3ad-44f3-9daa-fd33a208bfa3 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df" status: 200 len: 344 microversion: 2.1 time: 0.218558 Jul 18 14:08:28.462444 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 2/4] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:28 2022] GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df => generated 344 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:29.339865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d8b9b55b-85fe-4192-9988-1d58559e424f tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Calling method '.version_select at 0x7f7b4119d8b0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:29.441163 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d8b9b55b-85fe-4192-9988-1d58559e424f tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3" status: 200 len: 352 microversion: 2.1 time: 0.106845 Jul 18 14:08:29.446992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 3/5] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:29 2022] GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:29.474438 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9f2cdb48-194d-46ee-b8db-867c76608626 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b4119f820>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:29.560451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9f2cdb48-194d-46ee-b8db-867c76608626 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df" status: 200 len: 344 microversion: 2.1 time: 0.089749 Jul 18 14:08:29.561173 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 3/6] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:29 2022] GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:30.454812 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-495a1aa3-d921-4c49-a461-f20517fd1593 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Calling method '.version_select at 0x7f7b4119dee0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:30.525589 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-495a1aa3-d921-4c49-a461-f20517fd1593 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3" status: 200 len: 353 microversion: 2.1 time: 0.074351 Jul 18 14:08:30.528434 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 4/7] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:30 2022] GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:30.540084 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8fa798f1-8219-40f3-a520-21c0418ccc98 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Calling method '.version_select at 0x7f7b4119fe50>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:30.572383 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4637cae9-a0bb-4ba5-a363-349abdce71b9 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411ae5e0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:30.639785 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8fa798f1-8219-40f3-a520-21c0418ccc98 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3" status: 200 len: 353 microversion: 2.1 time: 0.103339 Jul 18 14:08:30.655360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 4/8] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:30 2022] GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:30.669464 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-88e4751d-7b8b-4bf3-b716-e932e71a2034 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Calling method '.version_select at 0x7f7b411b65e0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:30.717223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4637cae9-a0bb-4ba5-a363-349abdce71b9 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df" status: 200 len: 345 microversion: 2.1 time: 0.147352 Jul 18 14:08:30.719090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 5/9] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:30 2022] GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:30.734477 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3246de49-f093-4c88-8b63-321201871b9b tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Action: 'create', calling method: .version_select at 0x7f7b4119ddc0>, body: {"snapshot": {"volume_id": "bd825661-55a7-4856-9ca3-9ccb5eed31df", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-754646528"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:30.858783 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-88e4751d-7b8b-4bf3-b716-e932e71a2034 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3" status: 202 len: 0 microversion: 2.1 time: 0.201394 Jul 18 14:08:30.864089 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 5/10] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:08:30 2022] DELETE /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:08:30.873895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-230335d5-1a61-4dbe-93ee-49cf61034a32 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Calling method '.version_select at 0x7f7b4119fd30>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:30.987823 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-230335d5-1a61-4dbe-93ee-49cf61034a32 tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3" status: 200 len: 352 microversion: 2.1 time: 0.121558 Jul 18 14:08:30.989457 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 6/11] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:30 2022] GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:31.118074 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3246de49-f093-4c88-8b63-321201871b9b tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.392274 Jul 18 14:08:31.119256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 6/12] 10.222.0.94 () {60 vars in 1161 bytes} [Mon Jul 18 14:08:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:31.133320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d3eccd5e-646a-4f57-8089-7d834038d87a tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b4119fa60>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:31.269084 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d3eccd5e-646a-4f57-8089-7d834038d87a tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.142736 Jul 18 14:08:31.270165 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 7/13] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:31 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:31.282317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6e2d54b9-b65a-44e8-a9c8-d450292d52c0 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411ae700>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:31.385990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6e2d54b9-b65a-44e8-a9c8-d450292d52c0 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.110060 Jul 18 14:08:31.386560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 7/14] 10.222.0.94 () {58 vars in 1139 bytes} [Mon Jul 18 14:08:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:08:31.402296 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-802cbb43-4f7c-4c82-808d-e9ed0eba02e1 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411b6550>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:31.535762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-802cbb43-4f7c-4c82-808d-e9ed0eba02e1 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.139410 Jul 18 14:08:31.544486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 8/15] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:31 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:32.004396 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f4736012-43a4-4b88-a2ae-c5517f0c072c tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Calling method '.version_select at 0x7f7b411c01f0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:32.155689 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-f4736012-43a4-4b88-a2ae-c5517f0c072c tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] HTTP exception thrown: Volume 1ac873e3-30a1-4a69-b7df-ad02b74039d3 could not be found. Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f4736012-43a4-4b88-a2ae-c5517f0c072c tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Request method failure captured: Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 HTTP/1.1 Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlZBjn9JAwcs8TA-VSYa9w2Tjoz8r1iJ3xCs3fY5t1oe3pTrFy_U5_3vdxH3gwoM74TBbmLf0NSkOIk0lFpkWvdPBqV1JyOCus0F3OFilF_zAyOY-SBI8lteRfXrRlQlf-xLcflVzIFEwc9Bxis9R3H9dd_ARLtRfsXuvzR0Gt52hs Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: da8ad8d14f4a4e4bac2c0b60f7ccfcac Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesGetTestJSON-1299582396 Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:08:32.161114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/da8ad8d14f4a4e4bac2c0b60f7ccfcac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/da8ad8d14f4a4e4bac2c0b60f7ccfcac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/da8ad8d14f4a4e4bac2c0b60f7ccfcac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_da8ad8d14f4a4e4bac2c0b60f7ccfcac"}]}] Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesGetTestJSON-1299582396 Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: da8ad8d14f4a4e4bac2c0b60f7ccfcac Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesGetTestJSON-1299582396 Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesGetTestJSON-1299582396-project Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: ac1a4dab03104482813134c664f34de6 Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesGetTestJSON-1299582396-project Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Volume 1ac873e3-30a1-4a69-b7df-ad02b74039d3 could not be found. Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '1ac873e3-30a1-4a69-b7df-ad02b74039d3'} Jul 18 14:08:32.162333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ac873e3-30a1-4a69-b7df-ad02b74039d3 could not be found. (HTTP 404) (Request-ID: req-95d84735-d8d3-41a0-ab77-8944b518e899) Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:32.163002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:32.163984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ac873e3-30a1-4a69-b7df-ad02b74039d3 could not be found. Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:08:32.164895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ac873e3-30a1-4a69-b7df-ad02b74039d3 could not be found. Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ac873e3-30a1-4a69-b7df-ad02b74039d3 could not be found. Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f4736012-43a4-4b88-a2ae-c5517f0c072c tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] Returning 404 to user: Volume 1ac873e3-30a1-4a69-b7df-ad02b74039d3 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f4736012-43a4-4b88-a2ae-c5517f0c072c tempest-VolumesGetTestJSON-1299582396 tempest-VolumesGetTestJSON-1299582396-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3" status: 404 len: 109 microversion: 2.1 time: 0.162308 Jul 18 14:08:32.165803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 8/16] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:31 2022] GET /compute/v2.1/os-volumes/1ac873e3-30a1-4a69-b7df-ad02b74039d3 => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:32.559256 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fa0f45f1-4960-44e5-bc3f-7f6f8736969e tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b4119f820>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:32.638421 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fa0f45f1-4960-44e5-bc3f-7f6f8736969e tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.085065 Jul 18 14:08:32.639653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 9/17] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:32 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:33.651718 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-53a33f3a-cdbe-496e-bd73-56340367a4dc tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411c0550>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:33.718934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-53a33f3a-cdbe-496e-bd73-56340367a4dc tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.071815 Jul 18 14:08:33.728205 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 9/18] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:33 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:34.742800 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ade71c24-6c33-4097-8185-1016247eae30 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b4119fe50>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:34.802668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ade71c24-6c33-4097-8185-1016247eae30 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.067582 Jul 18 14:08:34.804944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 10/19] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:34 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:35.821706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3bf0ccc8-93db-4efe-a2bd-715f6cd4bc8d tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b41b838b0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:35.882273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3bf0ccc8-93db-4efe-a2bd-715f6cd4bc8d tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.067871 Jul 18 14:08:35.883710 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 10/20] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:35 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:36.895539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5ffc3652-b715-4ae6-bef5-b1aead351a6d tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411c0310>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:36.948792 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5ffc3652-b715-4ae6-bef5-b1aead351a6d tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.057933 Jul 18 14:08:36.950679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 11/21] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:36 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:37.445817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e5494718-8d6c-4fd1-90a0-b14e99b866fd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: .version_select at 0x7f7b411b6670>, body: {"keypair": {"name": "tempest-keypair-751513632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEWDn99iZYqNzGfgrVMmwjmvx5cux3/oWI6TD3/RbBoEjuwnYK7hdNVl/4UgQutxO/w1m523u/WnXZpPSV084PzPnhmAbJKMenfn0usdf7SFLVEDzebqMiSR9Te0fnJ6w=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:37.610548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e5494718-8d6c-4fd1-90a0-b14e99b866fd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:37.630194 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e5494718-8d6c-4fd1-90a0-b14e99b866fd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:37.764885 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e5494718-8d6c-4fd1-90a0-b14e99b866fd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.997282 Jul 18 14:08:37.766112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 11/22] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:08:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:37.962568 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cc5d25b7-11f0-40fb-b79b-3ba3e119edf8 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411c0940>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:38.039134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cc5d25b7-11f0-40fb-b79b-3ba3e119edf8 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 287 microversion: 2.1 time: 0.082241 Jul 18 14:08:38.040218 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 12/23] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:37 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:38.064313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cb423842-e279-480e-beee-96e910abcd96 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411114c0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:38.209496 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cb423842-e279-480e-beee-96e910abcd96 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "DELETE /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 202 len: 0 microversion: 2.1 time: 0.162578 Jul 18 14:08:38.210831 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 12/24] 10.222.0.94 () {58 vars in 1253 bytes} [Mon Jul 18 14:08:38 2022] DELETE /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:08:38.221583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e6011391-8639-4ef1-b095-50d38cfaba39 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b4112b040>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:38.334715 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e6011391-8639-4ef1-b095-50d38cfaba39 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.117841 Jul 18 14:08:38.345669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 13/25] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:38 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:39.349287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c2f58376-43f6-468b-a937-14207a7b6856 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b41143280>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:39.419478 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c2f58376-43f6-468b-a937-14207a7b6856 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.076530 Jul 18 14:08:39.424355 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 13/26] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:39 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:40.431249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5e9bfbf3-1a97-4ac2-affd-7cf727d077e0 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411c0820>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:40.488413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5e9bfbf3-1a97-4ac2-affd-7cf727d077e0 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.060742 Jul 18 14:08:40.496111 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 14/27] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:40 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:41.218204 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1020977937", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee89766c-7eb8-4f64-a3df-79441574b226"}], "security_groups": [{"name": "tempest-securitygroup--2006975588"}], "key_name": "tempest-keypair-751513632", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:41.506250 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d128f0cd-7ab6-4bb3-86f4-b1f7850b587c tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411c0160>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:41.511419 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] validate_networks() for [('ee89766c-7eb8-4f64-a3df-79441574b226', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:08:41.590432 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d128f0cd-7ab6-4bb3-86f4-b1f7850b587c tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 200 len: 286 microversion: 2.1 time: 0.089842 Jul 18 14:08:41.595313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 15/28] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:41 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:41.954981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-206532838", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "networks": [{"uuid": "cf7f0400-e048-424d-934c-355c986c5602"}]}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:42.133439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] validate_networks() for [('cf7f0400-e048-424d-934c-355c986c5602', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:08:42.899458 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:08:42.899906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:08:42.900586 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:08:42.901684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:08:42.902273 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:08:42.940380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:42.957358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:42.958490 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:42.959071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:42.997860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:43.003150 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:43.018014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:08:43.021245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:08:43.090728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:08:43.091241 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:08:43.091650 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:08:43.092089 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:08:43.092504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:08:43.117033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:43.117836 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:43.119807 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:43.124879 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:43.168758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-725a0754-65e3-48e7-805c-347f0e199ad4 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.953445 Jul 18 14:08:43.173085 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 14/29] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:08:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:08:43.185494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6a15fccf-6ac6-44a4-875b-b58844f3fa57 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b4085fb80>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:43.208573 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Getting quotas for project 799dde59367144af9f1f8cce1cb7d435. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:43.238633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Getting quotas for user 226d34540e464a93aa984ff59b497450 and project 799dde59367144af9f1f8cce1cb7d435. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:43.282132 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:08:43.284968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:08:43.320007 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-6a15fccf-6ac6-44a4-875b-b58844f3fa57 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] HTTP exception thrown: Snapshot 50ac32b3-4a1b-4759-a3c1-9e67dba78688 could not be found. Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6a15fccf-6ac6-44a4-875b-b58844f3fa57 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Request method failure captured: Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 HTTP/1.1 Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlZDjEZGh339jexWzQZOuFBn3zotsgBhVmx7rnb6L9rh6ybxZTpb-uHTp2vIM7l9AkSZLzZ2TdgUoOQlXDXcQ53mFJnpERphjMrG_kb1sMT7xULwci1Tdaeohv10M_poOPz74djeIv25oI1L9sNvFXXxuFh21TKEZLWvVBCMamRIKw Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:08:43.326755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_c9a6664b4d194755bc4b8e46ef187a7a"}]}] Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: d3e29b6b60a848d59e23128b1ada1d9d Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Snapshot 50ac32b3-4a1b-4759-a3c1-9e67dba78688 could not be found. Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '50ac32b3-4a1b-4759-a3c1-9e67dba78688'} Jul 18 14:08:43.328212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 50ac32b3-4a1b-4759-a3c1-9e67dba78688 could not be found. (HTTP 404) (Request-ID: req-b136bd17-3695-4b11-9324-975aebab961f) Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:08:43.328959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:43.329917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 50ac32b3-4a1b-4759-a3c1-9e67dba78688 could not be found. Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 14:08:43.330863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 50ac32b3-4a1b-4759-a3c1-9e67dba78688 could not be found. Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 50ac32b3-4a1b-4759-a3c1-9e67dba78688 could not be found. Jul 18 14:08:43.332265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:08:43.338675 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6a15fccf-6ac6-44a4-875b-b58844f3fa57 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Returning 404 to user: Snapshot 50ac32b3-4a1b-4759-a3c1-9e67dba78688 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:43.349512 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6a15fccf-6ac6-44a4-875b-b58844f3fa57 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688" status: 404 len: 111 microversion: 2.1 time: 0.173413 Jul 18 14:08:43.359863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 15/30] 10.222.0.94 () {58 vars in 1250 bytes} [Mon Jul 18 14:08:43 2022] GET /compute/v2.1/os-snapshots/50ac32b3-4a1b-4759-a3c1-9e67dba78688 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:43.453078 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-adf74df3-7a8e-4bf8-b2ce-bab71b9b0e88 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.745891 Jul 18 14:08:43.456007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 16/31] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:08:43.533769 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1098281577", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:43.677090 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] validate_networks() for [('1e995c6e-c3ce-4e05-9f56-a5572491371e', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:08:43.683382 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-afde053b-d198-4a32-9c66-cd2df1b55223 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'create', calling method: .version_select at 0x7f7b40820040>, body: {"keypair": {"name": "tempest-keypair-1846780889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLFP5/4a8Xiecnx3wOr/3G2G7g6BjdN5nCvpgPI0bTrORgfQ8D5qT41vaBxFrkJasKlaWHaAtw2YC85E6PRM15mgTbimgovenUTA3UUa5Vzndi4a4ehKkgvNZESVhG+Aw=="}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:43.735016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-afde053b-d198-4a32-9c66-cd2df1b55223 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for project 31755010e81b43908bbef9ae75eaaa64. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:43.756347 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-afde053b-d198-4a32-9c66-cd2df1b55223 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for user 0b6cb92018ea4cc5a25c5423b9bcd7a9 and project 31755010e81b43908bbef9ae75eaaa64. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:43.842321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-afde053b-d198-4a32-9c66-cd2df1b55223 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.385141 Jul 18 14:08:43.842945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 17/32] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:08:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:43.905411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9529b994-1abf-43b4-84a9-2404270fe7ec tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:43.909225 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9529b994-1abf-43b4-84a9-2404270fe7ec tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:44.287649 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9529b994-1abf-43b4-84a9-2404270fe7ec tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:44.347871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9529b994-1abf-43b4-84a9-2404270fe7ec tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1241 microversion: 2.1 time: 0.501236 Jul 18 14:08:44.362791 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 18/33] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:43 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1241 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:44.389691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5b3e428f-03f9-4781-bcb5-627477dbb466 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411c0700>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:44.560855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5b3e428f-03f9-4781-bcb5-627477dbb466 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df" status: 202 len: 0 microversion: 2.1 time: 0.194090 Jul 18 14:08:44.562613 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 19/34] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:08:44 2022] DELETE /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:08:44.578982 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dd03743f-8dc1-4877-be69-c96c50e5e535 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:44.579672 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dd03743f-8dc1-4877-be69-c96c50e5e535 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:44.851570 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dd03743f-8dc1-4877-be69-c96c50e5e535 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:44.866996 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dd03743f-8dc1-4877-be69-c96c50e5e535 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1214 microversion: 2.1 time: 0.302844 Jul 18 14:08:44.867667 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 20/35] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:44 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1214 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:44.894733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6401dae3-5db9-4a9a-8771-27ff2a529c69 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b411c0d30>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:45.031556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6401dae3-5db9-4a9a-8771-27ff2a529c69 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/22909e41-aae1-4593-98a6-b2078db955dd" status: 200 len: 351 microversion: 2.1 time: 0.150701 Jul 18 14:08:45.032524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 21/36] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:44 2022] GET /compute/v2.1/os-volumes/22909e41-aae1-4593-98a6-b2078db955dd => generated 351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:45.038086 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-021763ad-a14f-4fd1-937e-da1ff8f3bff3 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b3b7ef430>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:45.249387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-021763ad-a14f-4fd1-937e-da1ff8f3bff3 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] HTTP exception thrown: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-021763ad-a14f-4fd1-937e-da1ff8f3bff3 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Request method failure captured: Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df HTTP/1.1 Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlZDjEZGh339jexWzQZOuFBn3zotsgBhVmx7rnb6L9rh6ybxZTpb-uHTp2vIM7l9AkSZLzZ2TdgUoOQlXDXcQ53mFJnpERphjMrG_kb1sMT7xULwci1Tdaeohv10M_poOPz74djeIv25oI1L9sNvFXXxuFh21TKEZLWvVBCMamRIKw Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:08:45.251514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_c9a6664b4d194755bc4b8e46ef187a7a"}]}] Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: d3e29b6b60a848d59e23128b1ada1d9d Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'bd825661-55a7-4856-9ca3-9ccb5eed31df'} Jul 18 14:08:45.252702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. (HTTP 404) (Request-ID: req-d1588ab5-40d5-4e2e-9768-4616e4c66433) Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.253440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:45.255124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:08:45.256081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-021763ad-a14f-4fd1-937e-da1ff8f3bff3 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Returning 404 to user: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-021763ad-a14f-4fd1-937e-da1ff8f3bff3 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df" status: 404 len: 109 microversion: 2.1 time: 0.219328 Jul 18 14:08:45.256993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 22/37] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:45 2022] GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:45.272856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c5f79bc1-1977-4a1b-96c1-7945ee58af81 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b3b7c51f0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:45.465066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-c5f79bc1-1977-4a1b-96c1-7945ee58af81 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] HTTP exception thrown: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c5f79bc1-1977-4a1b-96c1-7945ee58af81 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Request method failure captured: Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: DELETE /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df HTTP/1.1 Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlZDjEZGh339jexWzQZOuFBn3zotsgBhVmx7rnb6L9rh6ybxZTpb-uHTp2vIM7l9AkSZLzZ2TdgUoOQlXDXcQ53mFJnpERphjMrG_kb1sMT7xULwci1Tdaeohv10M_poOPz74djeIv25oI1L9sNvFXXxuFh21TKEZLWvVBCMamRIKw Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:08:45.467473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_c9a6664b4d194755bc4b8e46ef187a7a"}]}] Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: d3e29b6b60a848d59e23128b1ada1d9d Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'bd825661-55a7-4856-9ca3-9ccb5eed31df'} Jul 18 14:08:45.468913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. (HTTP 404) (Request-ID: req-4bfb09d8-6f90-4a18-aeb6-b17efe470ea8) Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.469648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:08:45.470592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 14:08:45.471549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c5f79bc1-1977-4a1b-96c1-7945ee58af81 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Returning 404 to user: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:45.473709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c5f79bc1-1977-4a1b-96c1-7945ee58af81 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df" status: 404 len: 109 microversion: 2.1 time: 0.201551 Jul 18 14:08:45.477561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 23/38] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:08:45 2022] DELETE /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df => generated 109 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:08:45.488239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b7786628-01ed-443a-9d1e-a601b472ca3c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:45.493712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b7786628-01ed-443a-9d1e-a601b472ca3c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:45.554945 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:08:45.556039 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:08:45.557212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:08:45.557935 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:08:45.558493 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:08:45.573705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:45.580266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:45.582410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:45.592617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:45.673584 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for project eaf9f75abc034491bd1b8846c05bf625. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:45.679115 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b7786628-01ed-443a-9d1e-a601b472ca3c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:45.697700 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b7786628-01ed-443a-9d1e-a601b472ca3c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1241 microversion: 2.1 time: 0.213885 Jul 18 14:08:45.703118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for user 3720c2225b51464abee34d05a69b9db7 and project eaf9f75abc034491bd1b8846c05bf625. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:45.705085 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 24/39] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:45 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1241 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:45.720560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-262bf519-4cab-439f-a76e-6702c52e8cf7 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Calling method '.version_select at 0x7f7b411c0700>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:45.779498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:08:45.800624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:08:45.818049 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-262bf519-4cab-439f-a76e-6702c52e8cf7 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] HTTP exception thrown: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-262bf519-4cab-439f-a76e-6702c52e8cf7 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Request method failure captured: Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df HTTP/1.1 Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlZDjEZGh339jexWzQZOuFBn3zotsgBhVmx7rnb6L9rh6ybxZTpb-uHTp2vIM7l9AkSZLzZ2TdgUoOQlXDXcQ53mFJnpERphjMrG_kb1sMT7xULwci1Tdaeohv10M_poOPz74djeIv25oI1L9sNvFXXxuFh21TKEZLWvVBCMamRIKw Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:08:45.820048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/c9a6664b4d194755bc4b8e46ef187a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_c9a6664b4d194755bc4b8e46ef187a7a"}]}] Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: c9a6664b4d194755bc4b8e46ef187a7a Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054936470 Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: d3e29b6b60a848d59e23128b1ada1d9d Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054936470-project Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'bd825661-55a7-4856-9ca3-9ccb5eed31df'} Jul 18 14:08:45.821393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. (HTTP 404) (Request-ID: req-11b3bfea-65e0-4338-9b0a-f5b8805e105c) Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.822829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:08:45.824321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:08:45.825640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-262bf519-4cab-439f-a76e-6702c52e8cf7 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] Returning 404 to user: Volume bd825661-55a7-4856-9ca3-9ccb5eed31df could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:08:45.826884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-262bf519-4cab-439f-a76e-6702c52e8cf7 tempest-VolumesSnapshotsTestJSON-1054936470 tempest-VolumesSnapshotsTestJSON-1054936470-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df" status: 404 len: 109 microversion: 2.1 time: 0.115110 Jul 18 14:08:45.830561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 25/40] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:45 2022] GET /compute/v2.1/os-volumes/bd825661-55a7-4856-9ca3-9ccb5eed31df => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:45.883968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:45.885267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:45.919237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:45.919707 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:45.920554 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:45.921020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:46.029576 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-90573597-45a0-4e3a-bbe5-6c50b1a00543 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.667578 Jul 18 14:08:46.037266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 16/41] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:08:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:08:46.054238 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8a064240-87ca-4d58-b4b6-437ad91ac7e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:46.054860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8a064240-87ca-4d58-b4b6-437ad91ac7e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:46.286397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8a064240-87ca-4d58-b4b6-437ad91ac7e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:46.328653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8a064240-87ca-4d58-b4b6-437ad91ac7e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1222 microversion: 2.1 time: 0.286453 Jul 18 14:08:46.338833 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 17/42] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:46 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1222 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:46.556871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:46.576839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-124abc16-0b6d-4281-a784-4a24e32ae7ca tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1218 microversion: 2.1 time: 0.696975 Jul 18 14:08:46.578518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 26/43] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:45 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1218 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:46.694877 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1168355862", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:46.717818 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:46.718472 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:46.729985 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:46.730432 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:46.731221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:46.731660 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:46.869508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] validate_networks() for [('1e995c6e-c3ce-4e05-9f56-a5572491371e', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:08:47.386777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:47.394239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-53b2c7ff-66aa-43fa-a7f7-cec874756fff tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1237 microversion: 2.1 time: 0.680273 Jul 18 14:08:47.404134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 27/44] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:46 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1237 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:47.409058 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c4a27c32-600f-40c2-bddf-26d4859f0d4b tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b77d160>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:47.526294 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c4a27c32-600f-40c2-bddf-26d4859f0d4b tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/7ccf2b58-0d8c-4afa-b21e-d4430c3d2b9f" status: 200 len: 351 microversion: 2.1 time: 0.120202 Jul 18 14:08:47.527173 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 28/45] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:47 2022] GET /compute/v2.1/os-volumes/7ccf2b58-0d8c-4afa-b21e-d4430c3d2b9f => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:47.594356 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:47.595129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:47.608377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:47.612908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:47.613875 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:47.616990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:47.797103 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:47.807854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f3af38fd-6881-4f46-a6f9-9dc7dea9c80c tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1266 microversion: 2.1 time: 0.214989 Jul 18 14:08:47.811864 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 29/46] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:47 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:48.422253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:48.423113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:48.439153 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:48.442129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:48.444334 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:48.448617 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:49.039937 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:49.059775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-03ebde93-3be0-4e3f-8d0b-6f2812bc0642 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1301 microversion: 2.1 time: 0.641634 Jul 18 14:08:49.077270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 30/47] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:48 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1301 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:49.088267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:49.090090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:49.107521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:49.108468 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:49.109623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:49.117545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:49.294473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:49.309702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b73bf8bb-3159-4b50-bbd6-90d2c7168ac4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1272 microversion: 2.1 time: 0.228481 Jul 18 14:08:49.311310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 31/48] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:49 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:49.327062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-11f429b4-4ddc-42aa-9aca-bd2849e449e2 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b72d8b0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:49.410042 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-11f429b4-4ddc-42aa-9aca-bd2849e449e2 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/1f3c080a-5b70-4cce-b571-a11322ae1d24" status: 200 len: 350 microversion: 2.1 time: 0.095270 Jul 18 14:08:49.411129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 32/49] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:08:49 2022] GET /compute/v2.1/os-volumes/1f3c080a-5b70-4cce-b571-a11322ae1d24 => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:49.422415 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b36ecb53-5736-4e6f-a0a0-9ffe5f465847 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b6d6e50>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:49.440352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:08:49.440877 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:08:49.441252 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:08:49.442607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:08:49.443048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:08:49.456568 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:49.457029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:49.457819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:49.460610 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:49.503007 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for project eaf9f75abc034491bd1b8846c05bf625. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:49.510378 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for user 3720c2225b51464abee34d05a69b9db7 and project eaf9f75abc034491bd1b8846c05bf625. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:49.534308 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:08:49.536459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:08:49.630873 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b36ecb53-5736-4e6f-a0a0-9ffe5f465847 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.212391 Jul 18 14:08:49.631289 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ca0bb5d7-c28f-4aef-8b5f-9297e48b78ea tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.940874 Jul 18 14:08:49.632079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 33/50] 10.222.0.94 () {58 vars in 1133 bytes} [Mon Jul 18 14:08:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:49.645523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 18/51] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:08:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 2957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:08:49.659023 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-84b6505e-8098-498e-8f7b-eddfa6974c26 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:49.659241 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-48408832-7b50-477b-9447-aab9408bb75d tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b73d310>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:49.660820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-84b6505e-8098-498e-8f7b-eddfa6974c26 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:49.879383 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-48408832-7b50-477b-9447-aab9408bb75d tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.238173 Jul 18 14:08:49.880784 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 34/52] 10.222.0.94 () {58 vars in 1148 bytes} [Mon Jul 18 14:08:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:49.902038 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-faeb8d0a-dc05-4833-874b-05ff462b0373 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b7efe50>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:49.953814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-84b6505e-8098-498e-8f7b-eddfa6974c26 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:49.966621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-84b6505e-8098-498e-8f7b-eddfa6974c26 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1222 microversion: 2.1 time: 0.314912 Jul 18 14:08:49.967203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 19/53] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:49 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1222 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:50.083554 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:50.084207 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:50.123796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:50.127354 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:50.133249 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:50.135794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:50.230404 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-faeb8d0a-dc05-4833-874b-05ff462b0373 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.340693 Jul 18 14:08:50.231245 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 35/54] 10.222.0.94 () {58 vars in 1133 bytes} [Mon Jul 18 14:08:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:50.244400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-63cae02b-3084-4594-89c3-d40989ddc685 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b72d040>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:50.462539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-63cae02b-3084-4594-89c3-d40989ddc685 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.222860 Jul 18 14:08:50.463934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 36/55] 10.222.0.94 () {58 vars in 1166 bytes} [Mon Jul 18 14:08:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:50.469287 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:50.470167 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:50.483645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:50.484817 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:50.486379 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:50.487064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:50.695472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:50.726261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a5576aca-b20f-4902-a56a-9c48462bbbaa tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1299 microversion: 2.1 time: 0.646553 Jul 18 14:08:50.729499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 20/56] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:50 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1299 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:50.768314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ded74398-6b8c-477a-9fac-7c3cfc014b03 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b770e50>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:50.946942 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ded74398-6b8c-477a-9fac-7c3cfc014b03 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.215589 Jul 18 14:08:50.948428 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 21/57] 10.222.0.94 () {58 vars in 1169 bytes} [Mon Jul 18 14:08:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:50.961984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c672463a-9528-4c8c-b16f-e43f4daaf4b2 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b700c10>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:51.159031 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c672463a-9528-4c8c-b16f-e43f4daaf4b2 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.202070 Jul 18 14:08:51.159643 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 22/58] 10.222.0.94 () {58 vars in 1154 bytes} [Mon Jul 18 14:08:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:51.167312 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:51.172589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:51.205078 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:51.209883 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:51.210712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:51.212180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:51.374348 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:51.393607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7c3f2d05-8f76-483c-b52b-46476a9dab2e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1272 microversion: 2.1 time: 0.928329 Jul 18 14:08:51.408252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 37/59] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:50 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1272 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:51.442797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f028eb20-be5a-4c95-869a-a2cb43f916a2 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b73d160>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:51.602001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:51.611098 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-76e17aa0-bc5d-4aa8-8304-89476553c400 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1274 microversion: 2.1 time: 0.450066 Jul 18 14:08:51.614747 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 23/60] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:51 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1274 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:51.686277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f028eb20-be5a-4c95-869a-a2cb43f916a2 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.275539 Jul 18 14:08:51.687840 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 38/61] 10.222.0.94 () {58 vars in 1187 bytes} [Mon Jul 18 14:08:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:51.711690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a8aa2d68-bba3-4cbd-bb7e-3166a8d923f4 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] Calling method '.version_select at 0x7f7b3b700550>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:51.746409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:51.747025 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:51.762231 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:51.762682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:51.763470 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:51.763905 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:52.006828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a8aa2d68-bba3-4cbd-bb7e-3166a8d923f4 tempest-VolumesTestJSON-1814682056 tempest-VolumesTestJSON-1814682056-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.302195 Jul 18 14:08:52.007724 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 24/62] 10.222.0.94 () {58 vars in 1154 bytes} [Mon Jul 18 14:08:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:52.416754 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:52.417314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:52.433925 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:52.434971 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:52.437789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:52.443258 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:53.165650 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:54.298810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:54.306581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-909ec36e-5e98-4b38-9686-14b557c73ad2 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 1.895008 Jul 18 14:08:54.320874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 25/63] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:52 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 1910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:54.326491 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:54.327430 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:54.334921 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:54.335660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:54.339497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:54.341084 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:54.341763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:54.370814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-37e3eff9-5633-4875-b5b5-5a7577c92fd1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 2.616298 Jul 18 14:08:54.376285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 39/64] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:51 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:08:54.417305 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-749269059", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fe5b32f-d5fb-42fb-be1d-85bec4b26b97"}], "security_groups": [{"name": "tempest-securitygroup--1407152351"}], "key_name": "tempest-keypair-1846780889", "user_data": "}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:54.560359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:54.572660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1a89c320-ce5e-474e-af9c-127136679aae tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1280 microversion: 2.1 time: 0.249343 Jul 18 14:08:54.576882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 26/65] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:54 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:55.154753 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] validate_networks() for [('3fe5b32f-d5fb-42fb-be1d-85bec4b26b97', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:08:55.338668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:55.339855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:55.348584 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:55.349040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:55.349824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:55.350267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:55.684016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=16 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:57.450158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:57.470281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f9e503b1-71c8-4a92-b3d5-95fa9f20da81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 2.136485 Jul 18 14:08:57.472032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 27/66] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:55 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:57.497985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:57.499366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:57.526917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:57.527736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:57.529335 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:57.531022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:58.482065 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:08:58.488084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:08:58.489473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:08:58.491206 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:08:58.491781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:08:58.523019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:58.528079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:58.534336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:58.536546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:58.616622 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for project 31755010e81b43908bbef9ae75eaaa64. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:08:58.624443 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for user 0b6cb92018ea4cc5a25c5423b9bcd7a9 and project 31755010e81b43908bbef9ae75eaaa64. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:08:58.662645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:08:58.672146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:08:58.677883 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:08:58.686380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b1425e23-1d10-4ff0-b458-8187795c4aa0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 1.212642 Jul 18 14:08:58.689499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 28/67] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:57 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:08:58.701079 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:58.704504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:58.718596 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:58.722140 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:58.728307 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:58.733301 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:58.812373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-00235761-3606-427d-9109-98c9ebd3526d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.432697 Jul 18 14:08:58.819800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 40/68] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:08:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 4442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:08:59.478563 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:59.478813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-1e66e522-f2bd-485c-9ea1-8fe13a6ecdbd req-1fa9ad47-7b1f-4f2f-8520-f8e40ebd91bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81682a07-6e29-4bb9-bf6a-0ecad30d6ba2", "tag": "16a375c2-18fc-4790-abd2-72e134cdb799"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:08:59.553497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-1e66e522-f2bd-485c-9ea1-8fe13a6ecdbd req-1fa9ad47-7b1f-4f2f-8520-f8e40ebd91bb service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:59.554153 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-1e66e522-f2bd-485c-9ea1-8fe13a6ecdbd req-1fa9ad47-7b1f-4f2f-8520-f8e40ebd91bb service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:59.690425 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-1e66e522-f2bd-485c-9ea1-8fe13a6ecdbd req-1fa9ad47-7b1f-4f2f-8520-f8e40ebd91bb service nova] Creating event network-changed:16a375c2-18fc-4790-abd2-72e134cdb799 for instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 on hv-cinder-84984 Jul 18 14:08:59.693747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-1e66e522-f2bd-485c-9ea1-8fe13a6ecdbd req-1fa9ad47-7b1f-4f2f-8520-f8e40ebd91bb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 14:08:59.709423 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5efc7120-1de6-4281-8809-0a4c7c4814e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:59.711210 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5efc7120-1de6-4281-8809-0a4c7c4814e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:59.713928 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5efc7120-1de6-4281-8809-0a4c7c4814e8 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:59.718150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5efc7120-1de6-4281-8809-0a4c7c4814e8 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:59.769571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.compute.rpcapi [None req-5efc7120-1de6-4281-8809-0a4c7c4814e8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 14:08:59.778126 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5efc7120-1de6-4281-8809-0a4c7c4814e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117845) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 14:08:59.844449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5efc7120-1de6-4281-8809-0a4c7c4814e8 None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.020738 Jul 18 14:08:59.845676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 41/69] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:08:59.855450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:08:59.871877 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:08:59.900184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:59.901759 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:59.905420 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:08:59.906082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:08:59.959580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=26 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:00.393725 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:00.401895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9f78ed99-fca3-46f3-8858-58a53ee850c8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 1.711060 Jul 18 14:09:00.416090 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 29/70] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:58 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:00.429629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:00.430715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:00.447529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:00.449374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:00.452091 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:00.452786 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:01.112526 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:01.124270 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9d57c3f7-753e-40ec-ad5c-b420d6a2dad7 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1233 microversion: 2.1 time: 0.706707 Jul 18 14:09:01.126198 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 30/71] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:00 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1233 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:01.148339 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:01.158131 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:01.178903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:01.186025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:01.187081 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:01.188448 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:01.353457 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:01.361743 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a78a70e2-c072-4277-95fd-5d437004ff75 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 1.514852 Jul 18 14:09:01.373187 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 42/72] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:08:59 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:01.905729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-be18c96f-4af2-4b62-9ed8-1f41a1155721 req-7ac222bd-14c4-4023-aab4-9efd7f120544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ef7fb3-7048-49b7-83f5-1342dcd057ef", "tag": "78c5d199-882a-4557-82d5-faa7c5620eb9"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:01.921972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:01.932094 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-be18c96f-4af2-4b62-9ed8-1f41a1155721 req-7ac222bd-14c4-4023-aab4-9efd7f120544 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:01.934310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-be18c96f-4af2-4b62-9ed8-1f41a1155721 req-7ac222bd-14c4-4023-aab4-9efd7f120544 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:01.944723 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-21178475-bebb-48b7-9b8c-ae25d25be897 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.811575 Jul 18 14:09:01.947620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 31/73] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:01 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:01.963770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:01.971610 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:01.994491 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-be18c96f-4af2-4b62-9ed8-1f41a1155721 req-7ac222bd-14c4-4023-aab4-9efd7f120544 service nova] Creating event network-changed:78c5d199-882a-4557-82d5-faa7c5620eb9 for instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef on hv-cinder-84984 Jul 18 14:09:01.996891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:01.997671 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:01.999523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:02.007706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-be18c96f-4af2-4b62-9ed8-1f41a1155721 req-7ac222bd-14c4-4023-aab4-9efd7f120544 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.631585 Jul 18 14:09:02.009893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 43/74] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:02.012061 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:02.023834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-8a6dc3c5-be72-49c0-aa51-720a7db60301 req-e6609ef3-89d7-48bc-a0a2-21f683946e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e87ba3d-6fdc-4f00-872f-10529eae1db5", "tag": "caff2315-38e2-45b5-bb40-99b2083aaf3a"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:02.044742 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-8a6dc3c5-be72-49c0-aa51-720a7db60301 req-e6609ef3-89d7-48bc-a0a2-21f683946e14 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:02.045188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-8a6dc3c5-be72-49c0-aa51-720a7db60301 req-e6609ef3-89d7-48bc-a0a2-21f683946e14 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:02.070269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-8a6dc3c5-be72-49c0-aa51-720a7db60301 req-e6609ef3-89d7-48bc-a0a2-21f683946e14 service nova] Creating event network-changed:caff2315-38e2-45b5-bb40-99b2083aaf3a for instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 on hv-cinder-84984 Jul 18 14:09:02.081649 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-8a6dc3c5-be72-49c0-aa51-720a7db60301 req-e6609ef3-89d7-48bc-a0a2-21f683946e14 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068435 Jul 18 14:09:02.084126 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 44/75] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:02.145676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:02.152518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:02.162885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:02.163498 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:02.164837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:02.166300 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:02.780417 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:02.793681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3b474774-8b35-4fe2-a675-af5fece4cc90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1295 microversion: 2.1 time: 0.650286 Jul 18 14:09:02.796035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 45/76] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:02 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1295 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:02.819745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:02.827172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:02.848953 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:02.849649 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:02.853968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:02.854842 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:03.355113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:03.389958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8873f5bc-7944-470a-bd44-b276075b238d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 1.436758 Jul 18 14:09:03.391095 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 32/77] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:01 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:03.596459 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:03.606025 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e8993f1f-da0b-4688-a8a4-353ace73a360 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.808632 Jul 18 14:09:03.615831 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 46/78] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:02 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:03.625391 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:03.626286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:03.639673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:03.640134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:03.643805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:03.644560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:03.684823 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0730f1a9-03fd-428e-bb19-bca3fc3e5e3b tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Action: 'create', calling method: .version_select at 0x7f7b3b71fc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-73848673", "metadata": {"Type": "work"}}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0730f1a9-03fd-428e-bb19-bca3fc3e5e3b tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Request method failure captured: Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 120 Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wl-2Os_Y-FUJqz5jn6s9jo-5ZFlVsRchdh2hRfys1XGsDxsU-ZXZl29ky63mlbLreGDTjb20fv7dnMr6lBKw9VZvajXUU9nrsx5YH7HVhWwjcOpzq5bFfW_5B2eP5pmrjEdgrY7NUIaNuQ2yiBflWqakvMzL7EGbGTu0Yq6ufho4Hg Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:09:03.722880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9617e5278e9d4980bc5ebb70cb783f7f"}]}] Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: c39ebf4683ab46a481eda5bb567ee957 Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-73848673", "metadata": {"Type": "work"}}} Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: Jul 18 14:09:03.724311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-73848673', 'metadata': {'Type': 'work'}}}} Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise error Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:03.725272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 14:09:03.726825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 14:09:03.728381 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 14:09:03.728381 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.732682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0730f1a9-03fd-428e-bb19-bca3fc3e5e3b tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:03.733756 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0730f1a9-03fd-428e-bb19-bca3fc3e5e3b tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.341093 Jul 18 14:09:03.743914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 33/79] 10.222.0.94 () {60 vars in 1155 bytes} [Mon Jul 18 14:09:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:09:03.757071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-26b5ab38-e23c-48ed-aa0f-3224bcf48247 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Action: 'create', calling method: .version_select at 0x7f7b3b700700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-690434270", "metadata": {"Type": "work"}}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-26b5ab38-e23c-48ed-aa0f-3224bcf48247 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Request method failure captured: Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 119 Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wl-2Os_Y-FUJqz5jn6s9jo-5ZFlVsRchdh2hRfys1XGsDxsU-ZXZl29ky63mlbLreGDTjb20fv7dnMr6lBKw9VZvajXUU9nrsx5YH7HVhWwjcOpzq5bFfW_5B2eP5pmrjEdgrY7NUIaNuQ2yiBflWqakvMzL7EGbGTu0Yq6ufho4Hg Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:09:03.766500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9617e5278e9d4980bc5ebb70cb783f7f"}]}] Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: c39ebf4683ab46a481eda5bb567ee957 Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-690434270", "metadata": {"Type": "work"}}} Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: Jul 18 14:09:03.767646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-690434270', 'metadata': {'Type': 'work'}}}} Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise error Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi '0' Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:03.768402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 14:09:03.769515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 14:09:03.770482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 14:09:03.770482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.776106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-26b5ab38-e23c-48ed-aa0f-3224bcf48247 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:03.777322 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-26b5ab38-e23c-48ed-aa0f-3224bcf48247 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.028154 Jul 18 14:09:03.779093 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 34/80] 10.222.0.94 () {60 vars in 1155 bytes} [Mon Jul 18 14:09:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:09:03.795833 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4691b194-ce3d-4153-abb6-8d3b26634e36 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Action: 'create', calling method: .version_select at 0x7f7b3b700c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139419941", "metadata": {"Type": "work"}}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4691b194-ce3d-4153-abb6-8d3b26634e36 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Request method failure captured: Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 118 Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wl-2Os_Y-FUJqz5jn6s9jo-5ZFlVsRchdh2hRfys1XGsDxsU-ZXZl29ky63mlbLreGDTjb20fv7dnMr6lBKw9VZvajXUU9nrsx5YH7HVhWwjcOpzq5bFfW_5B2eP5pmrjEdgrY7NUIaNuQ2yiBflWqakvMzL7EGbGTu0Yq6ufho4Hg Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:09:03.798717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9617e5278e9d4980bc5ebb70cb783f7f"}]}] Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: c39ebf4683ab46a481eda5bb567ee957 Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-139419941", "metadata": {"Type": "work"}}} Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: Jul 18 14:09:03.800110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-139419941', 'metadata': {'Type': 'work'}}}} Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise error Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi '' Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:03.800890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 14:09:03.801985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 14:09:03.803041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 14:09:03.803041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.803041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4691b194-ce3d-4153-abb6-8d3b26634e36 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:03.803594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4691b194-ce3d-4153-abb6-8d3b26634e36 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014749 Jul 18 14:09:03.804791 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 35/81] 10.222.0.94 () {60 vars in 1155 bytes} [Mon Jul 18 14:09:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:09:03.814095 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-53a9c03f-8996-48a8-addc-8687c5d0f25c tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Calling method '.version_select at 0x7f7b3b71f040>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:03.853346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-53a9c03f-8996-48a8-addc-8687c5d0f25c tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] HTTP exception thrown: Volume tempest-invalid-239964901 could not be found. Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-53a9c03f-8996-48a8-addc-8687c5d0f25c tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Request method failure captured: Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-239964901 HTTP/1.1 Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wl-2Os_Y-FUJqz5jn6s9jo-5ZFlVsRchdh2hRfys1XGsDxsU-ZXZl29ky63mlbLreGDTjb20fv7dnMr6lBKw9VZvajXUU9nrsx5YH7HVhWwjcOpzq5bFfW_5B2eP5pmrjEdgrY7NUIaNuQ2yiBflWqakvMzL7EGbGTu0Yq6ufho4Hg Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:09:03.855835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9617e5278e9d4980bc5ebb70cb783f7f"}]}] Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: c39ebf4683ab46a481eda5bb567ee957 Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Volume tempest-invalid-239964901 could not be found. Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'tempest-invalid-239964901'} Jul 18 14:09:03.857097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-239964901 could not be found. (HTTP 404) (Request-ID: req-dcb285bd-fa85-467a-bc1f-cc24c7628275) Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.857773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:09:03.864470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-239964901 could not be found. Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:03.865508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-239964901 could not be found. Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-239964901 could not be found. Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-53a9c03f-8996-48a8-addc-8687c5d0f25c tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Returning 404 to user: Volume tempest-invalid-239964901 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-53a9c03f-8996-48a8-addc-8687c5d0f25c tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/tempest-invalid-239964901" status: 404 len: 98 microversion: 2.1 time: 0.047183 Jul 18 14:09:03.866530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 36/82] 10.222.0.94 () {58 vars in 1214 bytes} [Mon Jul 18 14:09:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-239964901 => generated 98 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 14:09:03.870412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:03.870833 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:03.884214 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:03.884694 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:03.885493 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:03.885931 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:03.917624 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:03.945104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e21bc623-6abe-4d7b-ba6c-dae0ff2b4aae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.328049 Jul 18 14:09:03.945703 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 47/83] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:03 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:03.950401 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-59d4fecf-3f34-49c3-a883-322aeead9794 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003695 Jul 18 14:09:03.951352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 48/84] 10.222.0.94 () {58 vars in 1139 bytes} [Mon Jul 18 14:09:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 14:09:03.969270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9fefd918-ade6-4cf2-ad1b-17f6faeda061 tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012168 Jul 18 14:09:03.970468 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 49/85] 10.222.0.94 () {58 vars in 1136 bytes} [Mon Jul 18 14:09:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 14:09:03.984909 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ad851939-34fe-4530-a785-081379e93dae tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Calling method '.version_select at 0x7f7b3b6d6dc0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:03.991747 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:04.002780 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d03e5437-8ee0-4551-882d-34d84e2d2c5e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1295 microversion: 2.1 time: 0.143479 Jul 18 14:09:04.010588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 37/86] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:03 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:04.037782 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-ad851939-34fe-4530-a785-081379e93dae tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] HTTP exception thrown: Volume c8d5b280-e31d-440c-8483-e4531693a33d could not be found. Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ad851939-34fe-4530-a785-081379e93dae tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Request method failure captured: Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: DELETE /compute/v2.1/os-volumes/c8d5b280-e31d-440c-8483-e4531693a33d HTTP/1.1 Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wl-2Os_Y-FUJqz5jn6s9jo-5ZFlVsRchdh2hRfys1XGsDxsU-ZXZl29ky63mlbLreGDTjb20fv7dnMr6lBKw9VZvajXUU9nrsx5YH7HVhWwjcOpzq5bFfW_5B2eP5pmrjEdgrY7NUIaNuQ2yiBflWqakvMzL7EGbGTu0Yq6ufho4Hg Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:09:04.040607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9617e5278e9d4980bc5ebb70cb783f7f"}]}] Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: c39ebf4683ab46a481eda5bb567ee957 Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Volume c8d5b280-e31d-440c-8483-e4531693a33d could not be found. Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'c8d5b280-e31d-440c-8483-e4531693a33d'} Jul 18 14:09:04.041979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8d5b280-e31d-440c-8483-e4531693a33d could not be found. (HTTP 404) (Request-ID: req-1ddf52b2-76e6-42e8-905b-6fe342775f96) Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:04.042904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:09:04.044145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8d5b280-e31d-440c-8483-e4531693a33d could not be found. Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 14:09:04.045159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8d5b280-e31d-440c-8483-e4531693a33d could not be found. Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8d5b280-e31d-440c-8483-e4531693a33d could not be found. Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ad851939-34fe-4530-a785-081379e93dae tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Returning 404 to user: Volume c8d5b280-e31d-440c-8483-e4531693a33d could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ad851939-34fe-4530-a785-081379e93dae tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/c8d5b280-e31d-440c-8483-e4531693a33d" status: 404 len: 109 microversion: 2.1 time: 0.066450 Jul 18 14:09:04.046133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 50/87] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:09:03 2022] DELETE /compute/v2.1/os-volumes/c8d5b280-e31d-440c-8483-e4531693a33d => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:09:04.052396 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9579ac1e-3674-4911-9fdf-c13d29f543ca tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Calling method '.version_select at 0x7f7b3b6bf160>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:04.085673 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-9579ac1e-3674-4911-9fdf-c13d29f543ca tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] HTTP exception thrown: Volume 2f63b5d5-cc82-4431-b1b7-3024c362b133 could not be found. Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9579ac1e-3674-4911-9fdf-c13d29f543ca tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Request method failure captured: Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/os-volumes/2f63b5d5-cc82-4431-b1b7-3024c362b133 HTTP/1.1 Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wl-2Os_Y-FUJqz5jn6s9jo-5ZFlVsRchdh2hRfys1XGsDxsU-ZXZl29ky63mlbLreGDTjb20fv7dnMr6lBKw9VZvajXUU9nrsx5YH7HVhWwjcOpzq5bFfW_5B2eP5pmrjEdgrY7NUIaNuQ2yiBflWqakvMzL7EGbGTu0Yq6ufho4Hg Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:09:04.088352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9617e5278e9d4980bc5ebb70cb783f7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9617e5278e9d4980bc5ebb70cb783f7f"}]}] Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9617e5278e9d4980bc5ebb70cb783f7f Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesNegativeTest-1430053126 Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: c39ebf4683ab46a481eda5bb567ee957 Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesNegativeTest-1430053126-project Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Volume 2f63b5d5-cc82-4431-b1b7-3024c362b133 could not be found. Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '2f63b5d5-cc82-4431-b1b7-3024c362b133'} Jul 18 14:09:04.089536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f63b5d5-cc82-4431-b1b7-3024c362b133 could not be found. (HTTP 404) (Request-ID: req-bd1d006c-8f86-4104-85ca-33a21bc41e38) Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:04.090275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:09:04.091293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f63b5d5-cc82-4431-b1b7-3024c362b133 could not be found. Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:09:04.092262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f63b5d5-cc82-4431-b1b7-3024c362b133 could not be found. Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f63b5d5-cc82-4431-b1b7-3024c362b133 could not be found. Jul 18 14:09:04.093222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:04.095405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9579ac1e-3674-4911-9fdf-c13d29f543ca tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] Returning 404 to user: Volume 2f63b5d5-cc82-4431-b1b7-3024c362b133 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:04.096410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9579ac1e-3674-4911-9fdf-c13d29f543ca tempest-VolumesNegativeTest-1430053126 tempest-VolumesNegativeTest-1430053126-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/2f63b5d5-cc82-4431-b1b7-3024c362b133" status: 404 len: 109 microversion: 2.1 time: 0.048628 Jul 18 14:09:04.097112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 38/88] 10.222.0.94 () {58 vars in 1244 bytes} [Mon Jul 18 14:09:04 2022] GET /compute/v2.1/os-volumes/2f63b5d5-cc82-4431-b1b7-3024c362b133 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:09:04.117099 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-11a5c432-cec9-4b24-8cf1-351db44b980e req-ff2271cb-db1d-499b-b7fa-53c7c8bf1aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b465817c-08b2-4f29-a439-143ad9d67561", "tag": "242eaddb-7d26-4618-bcb7-2932b894ee02"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:04.130663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-11a5c432-cec9-4b24-8cf1-351db44b980e req-ff2271cb-db1d-499b-b7fa-53c7c8bf1aba service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:04.131223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-11a5c432-cec9-4b24-8cf1-351db44b980e req-ff2271cb-db1d-499b-b7fa-53c7c8bf1aba service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:04.145446 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-11a5c432-cec9-4b24-8cf1-351db44b980e req-ff2271cb-db1d-499b-b7fa-53c7c8bf1aba service nova] Creating event network-changed:242eaddb-7d26-4618-bcb7-2932b894ee02 for instance b465817c-08b2-4f29-a439-143ad9d67561 on hv-cinder-84984 Jul 18 14:09:04.156174 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-11a5c432-cec9-4b24-8cf1-351db44b980e req-ff2271cb-db1d-499b-b7fa-53c7c8bf1aba service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040369 Jul 18 14:09:04.157082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 51/89] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:04.411327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:04.412694 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:04.420522 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:04.421567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:04.422758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:04.423355 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:04.623866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:04.624614 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:04.636355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:04.636996 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:04.638395 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:04.639101 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:04.892801 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:04.912290 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e61f29c9-9064-4582-bd14-3bb4a4cbaccc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.504913 Jul 18 14:09:04.912871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 39/90] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:04 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:04.962972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:04.964208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:04.974022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:04.974954 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:04.976944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:04.978614 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:05.003153 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:05.013395 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b8c3a401-a90c-4e5d-bf11-fedd38d26fcb tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.393797 Jul 18 14:09:05.013872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 52/91] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:04 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:05.033841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:05.034459 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:05.049533 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:05.051797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:05.054530 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:05.055592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:05.173350 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:05.181924 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8648e551-4719-4a65-91f1-d13fc45092c4 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1295 microversion: 2.1 time: 0.158048 Jul 18 14:09:05.182494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 53/92] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:05 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1295 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:05.248304 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:05.257132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-116cab4b-200a-4b7f-9e5b-a9482e6ec31f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.298677 Jul 18 14:09:05.260014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 40/93] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:04 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:05.928783 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:05.929896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:05.932504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:05.946109 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:05.947254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:05.949416 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:05.949600 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:05.956179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=93 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:06.030455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:06.031673 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:06.040346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:06.041099 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:06.042454 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:06.043155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:06.240453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:06.252003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e840cb1e-f800-4e35-8014-0e65ca26506e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.327657 Jul 18 14:09:06.253317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 54/94] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:05 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:06.259753 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:06.260568 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:06.268973 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:06.270018 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:06.271054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:06.271697 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:06.280901 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:06.291365 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-821a4aee-e46c-4384-b545-91541b060f81 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.265168 Jul 18 14:09:06.292755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 41/95] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:06 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:06.304817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:06.305629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:06.308700 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:06.312435 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:06.312962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:06.317252 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:06.317868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:06.350108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:06.359062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9dfb32c2-f2df-4b31-9a2d-0f5275804ddb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1295 microversion: 2.1 time: 0.104418 Jul 18 14:09:06.360784 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 55/96] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:06 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:06.514822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:06.525238 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0d63cbf0-29bd-4aca-90ce-98bb6c69b313 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.230696 Jul 18 14:09:06.526005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 42/97] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:06 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:07.270953 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:07.271676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:07.280670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.281124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.281901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.282337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.310433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:07.311160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:07.319927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.321179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.322780 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.323225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.336121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:07.511628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:07.518460 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-38648f6f-0ba3-44ff-9b20-1961a29636aa tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.251705 Jul 18 14:09:07.519033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 56/98] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:07 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:07.523575 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:07.524236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:07.530232 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.530678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.531449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.531889 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.548361 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:07.561254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-62618196-f2ca-4016-9079-dbc5f708ab1a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.255694 Jul 18 14:09:07.564594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 43/99] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:07 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:07.569668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:07.570454 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:07.579211 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.579658 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.580468 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:07.580897 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:07.603449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:07.611596 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-84c768de-9d7a-47f4-b380-2679f0aecca6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1295 microversion: 2.1 time: 0.091393 Jul 18 14:09:07.612188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 57/100] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:07 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:07.777121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:07.787433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-244cf399-7dce-48c1-a7f1-a3446caa50ac tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.221496 Jul 18 14:09:07.788921 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 44/101] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:07 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:08.585088 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:08.585618 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:08.588561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:08.590527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:08.626677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:08.627843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:08.628090 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:08.628542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:08.629409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:08.629907 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:08.630540 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:08.631676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:08.657169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:09.144853 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:09.154854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bee6974b-f052-4484-8c5f-c3fd6e43317c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.617856 Jul 18 14:09:09.155217 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:09.156064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 58/102] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:08 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:09.162171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:09.162646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1e0ad4cf-85dc-4963-8309-cadff8473f43 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.583687 Jul 18 14:09:09.163208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 45/103] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:08 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:09.163614 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:09.170251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:09.170858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:09.171767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:09.172279 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:09.183520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:09.186580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:09.193822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:09.194497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:09.195552 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:09.196220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:09.295012 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:09.311067 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-72b6af97-3b65-4928-b889-8e79ac0f9dd8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1295 microversion: 2.1 time: 0.152167 Jul 18 14:09:09.322747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 59/104] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:09 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1295 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:09.482270 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:09.491297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2a6319b6-6239-43e1-9bc2-4eb4c1dcd050 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.312217 Jul 18 14:09:09.491882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 46/105] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:09 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:10.172534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:10.173800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:10.175852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=4 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:10.179148 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:10.180908 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:10.183373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.186072 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.187355 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.187855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.188167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.188484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.189254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.189821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.385361 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:10.398397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fa09df06-ad06-49ec-87c7-ac9e72b8f587 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.221298 Jul 18 14:09:10.411800 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 47/106] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:10 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:10.423647 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:10.424697 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:10.443076 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.443602 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.444504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.445054 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.456017 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:10.465851 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-60d99765-3c8b-4167-8310-98522a2d187c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.296865 Jul 18 14:09:10.468358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 60/107] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:10 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:10.510863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:10.511926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:10.522043 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.522658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.524713 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:10.525649 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:10.700059 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:10.711759 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-88ff3f92-2be8-45b4-b8f9-fdb52cfa2b57 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.297803 Jul 18 14:09:10.712284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 48/108] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:10 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:10.785321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:10.799729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b32d717e-c439-4d19-96bc-e97ac6920118 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.290236 Jul 18 14:09:10.811255 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 61/109] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:10 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:11.418559 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:11.419180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:11.425291 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.425919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:11.426879 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.427345 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:11.487131 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:11.489736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:11.498660 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.499914 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:11.503539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.504309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:11.639478 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:11.650613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-eb36e19d-c9ec-4315-9be4-76ec1846717a tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.234899 Jul 18 14:09:11.652781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 49/110] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:11 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:11.722841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:11.730381 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:11.731714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:11.733309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8d32a304-1714-4ef1-8fa7-56e90647f401 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.252374 Jul 18 14:09:11.733892 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 62/111] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:11 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:11.769209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.771961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:11.773143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.773607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:11.819862 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:11.821081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:11.828841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.829290 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:11.830068 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:11.830500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:12.168645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:12.179701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-df9d2c1c-db91-4d29-a48f-f314b6fa1033 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.364590 Jul 18 14:09:12.181595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 63/112] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:11 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:12.196345 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:12.207162 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-72d454b0-9731-4678-a40f-a919ebd96cb5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.482944 Jul 18 14:09:12.210291 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 50/113] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:11 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:12.668993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:12.669740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:12.676543 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:12.676998 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:12.677776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:12.678339 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:12.750655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:12.751849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:12.771550 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:12.772033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:12.772817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:12.773252 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:13.276014 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:13.279455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:13.285188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f1f41e0a-3b60-4779-9e2c-bc2b3f24295e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.620843 Jul 18 14:09:13.286683 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 64/114] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:12 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:13.298324 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f5258137-4bb1-4938-95f1-9ed09b88e239 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.551439 Jul 18 14:09:13.298936 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 51/115] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:12 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:13.300247 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:13.300868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:13.305949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:13.306767 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:13.314891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:13.316572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:13.316716 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:13.317320 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:13.317517 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:13.318037 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:13.318651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:13.319738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:13.675595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:13.683586 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b0d20604-f7ff-4428-8ab5-9be0c9d3214a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.395294 Jul 18 14:09:13.684474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 65/116] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:13 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:13.696171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:13.705314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1359836f-2528-4ffe-98c3-f6e8f77e4f0b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.404264 Jul 18 14:09:13.705927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 52/117] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:13 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:14.284122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-96dd7bbd-b335-4278-ad00-5f1d87e69491 req-ce92af6f-2f52-4833-af0f-e952f3820b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc44e843-997b-458f-afa5-068509107496", "tag": "1923e5dd-1caf-42e2-a2c1-17454b860e6f"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:14.296556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-96dd7bbd-b335-4278-ad00-5f1d87e69491 req-ce92af6f-2f52-4833-af0f-e952f3820b30 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:14.299855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-96dd7bbd-b335-4278-ad00-5f1d87e69491 req-ce92af6f-2f52-4833-af0f-e952f3820b30 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:14.303054 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:14.303669 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:14.321265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:14.321728 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:14.326049 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:14.326591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:14.327347 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-96dd7bbd-b335-4278-ad00-5f1d87e69491 req-ce92af6f-2f52-4833-af0f-e952f3820b30 service nova] Creating event network-changed:1923e5dd-1caf-42e2-a2c1-17454b860e6f for instance bc44e843-997b-458f-afa5-068509107496 on hv-cinder-84984 Jul 18 14:09:14.344779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-96dd7bbd-b335-4278-ad00-5f1d87e69491 req-ce92af6f-2f52-4833-af0f-e952f3820b30 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064385 Jul 18 14:09:14.346162 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 66/118] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:14.362258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:14.364173 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:14.379236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:14.380969 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:14.384699 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:14.385677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:14.705527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:14.717607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0c76103e-d7e7-4743-8118-483135468364 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.416791 Jul 18 14:09:14.719510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 53/119] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:14 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:14.743750 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:14.749872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:14.771253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:14.772562 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:14.775248 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:14.782920 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:15.085080 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:15.094941 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-64988a08-4218-47e1-9308-469f522f4278 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.743666 Jul 18 14:09:15.104631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 67/120] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:14 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:15.104631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:15.105019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:15.118139 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:15.119959 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:15.120978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:15.127209 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:15.266266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:15.285422 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-62185b3a-ef08-474e-80b7-706263d0bc30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.564750 Jul 18 14:09:15.286676 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 54/121] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:14 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:15.738141 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:15.738821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:15.760541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:15.761422 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:15.762945 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:15.765155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:15.952244 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:15.968313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7a1709d8-7ff7-41d2-9b23-1dccb4db6657 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.871310 Jul 18 14:09:15.969215 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 68/122] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:15 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:16.159052 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-a9807fe5-d5be-49ad-be2c-431db8d6d2aa req-53083603-3696-487c-ba39-c1cf759bc44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81682a07-6e29-4bb9-bf6a-0ecad30d6ba2", "name": "network-vif-plugged", "status": "completed", "tag": "16a375c2-18fc-4790-abd2-72e134cdb799"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:16.167701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-a9807fe5-d5be-49ad-be2c-431db8d6d2aa req-53083603-3696-487c-ba39-c1cf759bc44a service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:16.168032 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-a9807fe5-d5be-49ad-be2c-431db8d6d2aa req-53083603-3696-487c-ba39-c1cf759bc44a service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:16.188712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-a9807fe5-d5be-49ad-be2c-431db8d6d2aa req-53083603-3696-487c-ba39-c1cf759bc44a service nova] Creating event network-vif-plugged:16a375c2-18fc-4790-abd2-72e134cdb799 for instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 on hv-cinder-84984 Jul 18 14:09:16.205447 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-a9807fe5-d5be-49ad-be2c-431db8d6d2aa req-53083603-3696-487c-ba39-c1cf759bc44a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234795 Jul 18 14:09:16.206038 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 69/123] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:16.215124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:16.215820 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:16.228765 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:16.229917 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:16.231854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:16.232922 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:16.407158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:16.421015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-46e1856e-3b1b-473f-8c30-e5941df7e8ae tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.688151 Jul 18 14:09:16.422474 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 55/124] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:15 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:16.430893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:16.432551 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:16.458403 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:16.459240 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:16.460398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:16.461725 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:16.778740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:16.790717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a8b014de-ee65-4dc4-9b3a-70e1f6cc831b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.581261 Jul 18 14:09:16.792499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 70/125] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:16 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:16.986320 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:16.987273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:17.003152 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.004146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.010917 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.023772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.071341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:17.079433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-124f75a8-8b20-40bb-8b3b-00f5716954d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.654378 Jul 18 14:09:17.081332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 56/126] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:16 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:17.438479 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:17.439327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:17.446949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.447661 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.448460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.449032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.820555 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:17.829595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-295cfb7c-6412-4152-bac2-1a790d21583f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.847880 Jul 18 14:09:17.833108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 71/127] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:16 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:17.850424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:17.852041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:17.858619 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.859293 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.860278 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:17.868659 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:17.873210 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=100 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:17.977278 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:17.986505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3425edd1-f5d9-4e64-b55c-187029ee9db8 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.550186 Jul 18 14:09:17.987715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 57/128] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:17 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:18.098960 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:18.100316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:18.107796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:18.108423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:18.109426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:18.110016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:18.249720 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:18.258849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-01ee4b12-75d6-4a9e-b08b-13b59e8c90e6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.424505 Jul 18 14:09:18.272535 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 72/129] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:17 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:18.283450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-4efcbb18-9353-44f0-bae4-a71912c902c8 req-ef97c08a-53ba-458e-9af8-c1cd3a0154a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ef7fb3-7048-49b7-83f5-1342dcd057ef", "name": "network-vif-plugged", "status": "completed", "tag": "78c5d199-882a-4557-82d5-faa7c5620eb9"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:18.298246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-4efcbb18-9353-44f0-bae4-a71912c902c8 req-ef97c08a-53ba-458e-9af8-c1cd3a0154a0 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:18.298922 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-4efcbb18-9353-44f0-bae4-a71912c902c8 req-ef97c08a-53ba-458e-9af8-c1cd3a0154a0 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:18.320337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-4efcbb18-9353-44f0-bae4-a71912c902c8 req-ef97c08a-53ba-458e-9af8-c1cd3a0154a0 service nova] Creating event network-vif-plugged:78c5d199-882a-4557-82d5-faa7c5620eb9 for instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef on hv-cinder-84984 Jul 18 14:09:18.332408 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-4efcbb18-9353-44f0-bae4-a71912c902c8 req-ef97c08a-53ba-458e-9af8-c1cd3a0154a0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057814 Jul 18 14:09:18.335280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 73/130] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:18.340167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:18.353436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6cd42b15-a832-41f9-9325-44e2bdd44dcd tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.258654 Jul 18 14:09:18.354821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 58/131] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:18 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:18.854249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:18.855048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:18.861744 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:18.862511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:18.864426 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:18.865449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.005035 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:19.006048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:19.020205 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.021030 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.024082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.024541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.223066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:19.238388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-deb448bb-2afa-4cc7-8034-7a4ce594ed88 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.391802 Jul 18 14:09:19.239010 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 74/132] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:18 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:19.279233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:19.280079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:19.287322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.287770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.296015 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.296507 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.372803 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:19.376103 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:19.388179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5245c9d3-b6cf-44ea-adb9-e731ed6d14cc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1314 microversion: 2.1 time: 0.382823 Jul 18 14:09:19.389196 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 59/133] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:18 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:19.401744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:19.402544 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:19.416908 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.418420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.420298 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:19.421293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:19.628560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:19.656599 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-48115f92-73e3-446c-af83-5548ec7bf50b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.381150 Jul 18 14:09:19.657243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 75/134] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:19 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:19.673534 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:19.687516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-14e60ee8-0d16-4bd8-aeda-ba59bdd9a2ca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.293156 Jul 18 14:09:19.688346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 60/135] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:19 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:20.257904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:20.258523 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:20.292540 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.293411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.295508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.298503 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.355937 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-8c69eff8-d322-4788-8cb4-b0bb779939a1 req-6d18412d-8635-48b5-ae3c-249b5b54b0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e87ba3d-6fdc-4f00-872f-10529eae1db5", "name": "network-vif-plugged", "status": "completed", "tag": "caff2315-38e2-45b5-bb40-99b2083aaf3a"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:20.384461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8c69eff8-d322-4788-8cb4-b0bb779939a1 req-6d18412d-8635-48b5-ae3c-249b5b54b0bd service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.387809 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8c69eff8-d322-4788-8cb4-b0bb779939a1 req-6d18412d-8635-48b5-ae3c-249b5b54b0bd service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.441982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-8c69eff8-d322-4788-8cb4-b0bb779939a1 req-6d18412d-8635-48b5-ae3c-249b5b54b0bd service nova] Creating event network-vif-plugged:caff2315-38e2-45b5-bb40-99b2083aaf3a for instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 on hv-cinder-84984 Jul 18 14:09:20.442540 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8c69eff8-d322-4788-8cb4-b0bb779939a1 req-6d18412d-8635-48b5-ae3c-249b5b54b0bd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 14:09:20.446021 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db3f41e9-7a27-4e10-8410-6d7265ee8456 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.446474 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db3f41e9-7a27-4e10-8410-6d7265ee8456 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.447285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db3f41e9-7a27-4e10-8410-6d7265ee8456 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.447730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db3f41e9-7a27-4e10-8410-6d7265ee8456 None None] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.468570 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.compute.rpcapi [None req-db3f41e9-7a27-4e10-8410-6d7265ee8456 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 14:09:20.469481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db3f41e9-7a27-4e10-8410-6d7265ee8456 None None] Releasing lock "compute-rpcapi-router" {{(pid=117846) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 14:09:20.489171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-db3f41e9-7a27-4e10-8410-6d7265ee8456 None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138459 Jul 18 14:09:20.494898 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 61/136] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:09:20.501330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:20.502051 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:20.511068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.511668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.512491 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.512930 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.659365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:20.670517 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8c41374a-054c-4983-b30d-56af7636cd6d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.416972 Jul 18 14:09:20.671103 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 76/137] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:20 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:20.677122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:20.678076 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:20.684307 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.684861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.685863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.686370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.740302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:20.751187 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4086cded-cd91-4b64-9c90-08d567967adc tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1501 microversion: 2.1 time: 0.254990 Jul 18 14:09:20.752220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 62/138] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:20 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:20.759360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:20.760438 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:20.780410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.780857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:20.782181 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:20.782717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:21.072723 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:21.087565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8a32bf35-f65f-4f44-b67d-bf32fa7d7cdc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.414756 Jul 18 14:09:21.088191 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 77/139] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:20 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:21.115170 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:21.123865 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-39293910-4cfe-4b2c-9445-fd88a810cea2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.370268 Jul 18 14:09:21.124884 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 63/140] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:20 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:21.689169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:21.689779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:21.698697 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:21.699511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:21.701691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:21.702307 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:21.860905 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:21.868342 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-30b2fa7b-c817-43e7-86dc-6b3cc01acd8a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.185231 Jul 18 14:09:21.871990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 78/141] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:21 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:22.104825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:22.105450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:22.112793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.113243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.114070 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.114517 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.146578 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:22.147430 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:22.172204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.173011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.173976 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.183994 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.414878 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:22.435227 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9163c8c6-8b7e-4b3b-9b19-570d41c9ae88 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.292320 Jul 18 14:09:22.448099 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 79/142] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:22 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:22.462410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:22.482399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7b98f072-64b1-4e54-bb39-cbbba85cf171 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.370100 Jul 18 14:09:22.488236 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 64/143] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:22 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:22.498525 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-914432d6-49e1-43b8-ab07-84aa6a0cbdb4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce54aad6-d115-44ab-9068-933c62e4bc20"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:22.499671 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-914432d6-49e1-43b8-ab07-84aa6a0cbdb4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:22.507003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914432d6-49e1-43b8-ab07-84aa6a0cbdb4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.507492 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914432d6-49e1-43b8-ab07-84aa6a0cbdb4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.508347 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914432d6-49e1-43b8-ab07-84aa6a0cbdb4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.508771 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914432d6-49e1-43b8-ab07-84aa6a0cbdb4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.887450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:22.888460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:22.895733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.896424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:22.897193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:22.897796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:23.056105 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:23.064117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5c4da69a-7b05-4d03-853c-fe179684f29f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.181264 Jul 18 14:09:23.073533 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 65/144] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:22 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:23.456265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:23.456753 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:23.466946 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:23.468453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:23.469241 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:23.472852 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:23.604128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-914432d6-49e1-43b8-ab07-84aa6a0cbdb4 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "POST /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.109279 Jul 18 14:09:23.609410 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 80/145] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:09:22 2022] POST /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2/os-volume_attachments => generated 194 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:23.624207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:23.625266 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:23.632325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:23.632863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:23.633725 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:23.634260 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:23.810371 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:23.818909 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7b34a550-1408-4542-ab2f-f9f8f23973f1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.369962 Jul 18 14:09:23.819666 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 66/146] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:23 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:23.830545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:23.838633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-de36f2e0-8cf3-47c4-81f0-1f7021dac95a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.232500 Jul 18 14:09:23.839254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 81/147] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:23 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:24.080561 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:24.081292 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:24.087581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.088054 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:24.088832 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.089478 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:24.238876 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:24.251264 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-daf6592d-6d23-4365-8327-e2a69375ad74 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.174537 Jul 18 14:09:24.251978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 67/148] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:24 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:24.837421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:24.838166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:24.844577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.845188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:24.846237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.846865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:24.854982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:24.855654 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:24.864106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.864546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:24.865319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:24.866133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:25.075264 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:25.084856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7797203f-ca6d-41d7-9773-229ddbeb3299 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.251595 Jul 18 14:09:25.086236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 82/149] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:24 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:25.116217 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:25.124009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b880e98d-1680-4182-8b45-6ff2c2c70098 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.272982 Jul 18 14:09:25.124704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 68/150] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:24 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:25.269266 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:25.269902 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:25.277174 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:25.277623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:25.278731 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:25.279380 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:25.283911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-81346022-061c-4384-a339-13d0e96cb759 req-3e62e205-de56-4ff2-8ead-e26876a0b104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b465817c-08b2-4f29-a439-143ad9d67561", "name": "network-vif-plugged", "status": "completed", "tag": "242eaddb-7d26-4618-bcb7-2932b894ee02"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:25.297033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-81346022-061c-4384-a339-13d0e96cb759 req-3e62e205-de56-4ff2-8ead-e26876a0b104 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:25.297757 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-81346022-061c-4384-a339-13d0e96cb759 req-3e62e205-de56-4ff2-8ead-e26876a0b104 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:25.315442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-81346022-061c-4384-a339-13d0e96cb759 req-3e62e205-de56-4ff2-8ead-e26876a0b104 service nova] Creating event network-vif-plugged:242eaddb-7d26-4618-bcb7-2932b894ee02 for instance b465817c-08b2-4f29-a439-143ad9d67561 on hv-cinder-84984 Jul 18 14:09:25.325530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-81346022-061c-4384-a339-13d0e96cb759 req-3e62e205-de56-4ff2-8ead-e26876a0b104 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047337 Jul 18 14:09:25.327223 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 69/151] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:09:25.475341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:25.483836 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ef0950c0-646d-4601-a592-5a58b4ba4f65 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.218715 Jul 18 14:09:25.484519 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 83/152] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:25 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:26.105071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:26.105932 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:26.113440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.113935 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.115295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.115838 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.142643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:26.143840 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:26.151581 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.152251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.153615 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.154153 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.403347 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:26.407262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:26.411192 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d8ad41d3-ef6c-4e0f-9654-185aecdcc366 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.273244 Jul 18 14:09:26.412007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 84/153] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:26 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:26.418956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-032997ec-b300-46da-b3fa-2ca3faeb6b4f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1367 microversion: 2.1 time: 0.319312 Jul 18 14:09:26.423890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 70/154] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:26 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:26.502450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:26.503233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:26.511107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.511884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.513283 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:26.514052 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:26.654004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:26.662235 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4a485992-bd10-44f2-82fa-f5ad2b12f86d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.164447 Jul 18 14:09:26.662790 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 85/155] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:26 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:27.359102 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-6ad9ed4d-ca57-487f-90d0-266c16d82834 req-e07d72c2-9bec-44ae-8d38-14e9b0adfcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc44e843-997b-458f-afa5-068509107496", "name": "network-vif-plugged", "status": "completed", "tag": "1923e5dd-1caf-42e2-a2c1-17454b860e6f"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:27.368919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-6ad9ed4d-ca57-487f-90d0-266c16d82834 req-e07d72c2-9bec-44ae-8d38-14e9b0adfcae service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.369282 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-6ad9ed4d-ca57-487f-90d0-266c16d82834 req-e07d72c2-9bec-44ae-8d38-14e9b0adfcae service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.381055 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-6ad9ed4d-ca57-487f-90d0-266c16d82834 req-e07d72c2-9bec-44ae-8d38-14e9b0adfcae service nova] Creating event network-vif-plugged:1923e5dd-1caf-42e2-a2c1-17454b860e6f for instance bc44e843-997b-458f-afa5-068509107496 on hv-cinder-84984 Jul 18 14:09:27.390581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-6ad9ed4d-ca57-487f-90d0-266c16d82834 req-e07d72c2-9bec-44ae-8d38-14e9b0adfcae service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036062 Jul 18 14:09:27.391186 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 71/156] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:09:27.428687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:27.431246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:27.437811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.438366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.439268 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.439977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:27.440233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.442738 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:27.460397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.463454 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.464929 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.466440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.739150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:27.749160 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1ee576c9-7550-4cd0-9269-b0107b2c8916 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.324374 Jul 18 14:09:27.750582 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 86/157] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:27 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:27.753237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:27.756323 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:27.757142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:27.762549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d985682a-0e34-422a-8866-f97a6e03cc5a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1556 microversion: 2.1 time: 0.328949 Jul 18 14:09:27.763340 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 72/158] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:27 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1556 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:27.768385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.768890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.769676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.770116 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.779609 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3a951e16-16c6-4901-af38-4e81ce93ffab tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:27.780136 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3a951e16-16c6-4901-af38-4e81ce93ffab tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:27.786346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a951e16-16c6-4901-af38-4e81ce93ffab tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.786684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a951e16-16c6-4901-af38-4e81ce93ffab tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.787448 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a951e16-16c6-4901-af38-4e81ce93ffab tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:27.788072 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a951e16-16c6-4901-af38-4e81ce93ffab tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:27.947576 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3a951e16-16c6-4901-af38-4e81ce93ffab tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171807 Jul 18 14:09:27.948968 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 73/159] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:09:27 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:09:27.970726 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:27.978556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1bed63b4-7584-4c17-8826-b3dc9b9716e5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.226717 Jul 18 14:09:27.979252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 87/160] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:27 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:28.766564 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:28.767199 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:28.773894 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:28.774679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:28.775530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:28.776021 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:28.937807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:28.961394 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f738669d-2add-4414-a32f-af7224fd629c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.199090 Jul 18 14:09:28.962329 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 74/161] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:28 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:29.004188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:29.004913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:29.012092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:29.012633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:29.013493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:29.014002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:29.041072 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:29.197923 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:29.208590 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fc4e9157-0b98-4a42-9403-281ae6f83749 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.215889 Jul 18 14:09:29.209715 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 88/162] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:28 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:29.481414 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-f9fe8567-72f6-4874-9e35-5b3e4c32af58 req-909c7ed0-87d1-4723-b45b-232f5d5df284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8ef7fb3-7048-49b7-83f5-1342dcd057ef", "tag": "78c5d199-882a-4557-82d5-faa7c5620eb9"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:29.489699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f9fe8567-72f6-4874-9e35-5b3e4c32af58 req-909c7ed0-87d1-4723-b45b-232f5d5df284 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:29.490146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f9fe8567-72f6-4874-9e35-5b3e4c32af58 req-909c7ed0-87d1-4723-b45b-232f5d5df284 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:29.502588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-f9fe8567-72f6-4874-9e35-5b3e4c32af58 req-909c7ed0-87d1-4723-b45b-232f5d5df284 service nova] Creating event network-changed:78c5d199-882a-4557-82d5-faa7c5620eb9 for instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef on hv-cinder-84984 Jul 18 14:09:29.508235 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-f9fe8567-72f6-4874-9e35-5b3e4c32af58 req-909c7ed0-87d1-4723-b45b-232f5d5df284 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030246 Jul 18 14:09:29.508843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 75/163] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:29.979741 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:29.980367 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:29.986512 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:29.987148 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:29.988133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:29.988702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:30.152191 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:30.160944 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cbd9fe84-0be1-4993-942c-af8af70111b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1322 microversion: 2.1 time: 0.186037 Jul 18 14:09:30.161806 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 89/164] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:29 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:30.234209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:30.234629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:30.246712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:30.247231 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:30.251683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:30.253302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:30.466708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:30.513515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:30.532077 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-af055521-e450-4a94-a92f-9b50fad44581 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.303226 Jul 18 14:09:30.537487 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 76/165] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:30 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:31.179605 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:31.180410 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:31.193194 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.193834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.198400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.199046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.430566 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:31.443438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8ff82b0f-55cc-48dd-8e9a-4caf05b96a15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1515 microversion: 2.1 time: 0.268609 Jul 18 14:09:31.446007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 90/166] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:31 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:31.470554 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:31.474164 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:31.485941 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.486198 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.487146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.487905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.520714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lazy-loading 'flavor' on Instance uuid b465817c-08b2-4f29-a439-143ad9d67561 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:09:31.555010 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:31.555715 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:31.564158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.566595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.568278 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.569204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.639003 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:31.692376 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-65974a7a-56c1-4be9-8c81-c11177f0f24b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561/action" status: 200 len: 32 microversion: 2.1 time: 0.234340 Jul 18 14:09:31.693378 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 77/167] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:09:31 2022] POST /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561/action => generated 32 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:09:31.722841 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:31.726442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:31.753084 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.753440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.754218 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:31.754647 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:31.771478 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:31.790162 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1a042053-a4ca-4768-a357-b98457af55f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1363 microversion: 2.1 time: 0.239603 Jul 18 14:09:31.790814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 91/168] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:31 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:31.932104 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:31.951321 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-73426c27-d4e4-4e15-ac28-7c15a4a389c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.252077 Jul 18 14:09:31.956573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 78/169] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:31 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:32.807729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:32.808924 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:32.818806 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:32.819252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:32.820226 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:32.820826 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:32.970326 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:32.971928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:32.980668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:32.981468 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:32.982774 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:32.983375 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:33.289574 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:33.301403 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-956d0457-b06e-497e-9797-4d25a635c12e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1549 microversion: 2.1 time: 0.498094 Jul 18 14:09:33.314172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 92/170] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:32 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1549 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:33.321281 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-587910f8-f874-481e-8aec-f937013ca584 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:33.322431 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-587910f8-f874-481e-8aec-f937013ca584 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:33.329338 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-587910f8-f874-481e-8aec-f937013ca584 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:33.329789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-587910f8-f874-481e-8aec-f937013ca584 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:33.330554 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-587910f8-f874-481e-8aec-f937013ca584 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:33.330978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-587910f8-f874-481e-8aec-f937013ca584 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:33.335579 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:33.345249 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f75c598d-6728-4d17-9f90-e94a91232c8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.379937 Jul 18 14:09:33.349758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 79/171] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:32 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:33.488494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-587910f8-f874-481e-8aec-f937013ca584 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171948 Jul 18 14:09:33.498472 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 93/172] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:09:33 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:09:34.365167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:34.365769 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:34.378271 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:34.378710 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:34.379801 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:34.380879 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:34.555712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:34.565663 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-12c622a0-98e9-437d-bab4-704902ba2b85 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.204190 Jul 18 14:09:34.576846 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 80/173] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:34 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:34.783121 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-7b95e6d5-a9a5-4f3f-bcf3-c216695c557a req-ec21a56d-7514-4682-8095-e742fa10a5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc44e843-997b-458f-afa5-068509107496", "tag": "1923e5dd-1caf-42e2-a2c1-17454b860e6f"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:34.804948 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-7b95e6d5-a9a5-4f3f-bcf3-c216695c557a req-ec21a56d-7514-4682-8095-e742fa10a5c8 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:34.805521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-7b95e6d5-a9a5-4f3f-bcf3-c216695c557a req-ec21a56d-7514-4682-8095-e742fa10a5c8 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:34.823213 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-7b95e6d5-a9a5-4f3f-bcf3-c216695c557a req-ec21a56d-7514-4682-8095-e742fa10a5c8 service nova] Creating event network-changed:1923e5dd-1caf-42e2-a2c1-17454b860e6f for instance bc44e843-997b-458f-afa5-068509107496 on hv-cinder-84984 Jul 18 14:09:34.829566 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-7b95e6d5-a9a5-4f3f-bcf3-c216695c557a req-ec21a56d-7514-4682-8095-e742fa10a5c8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050695 Jul 18 14:09:34.830441 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 94/174] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:35.592459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:35.597572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:35.627616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:35.628097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:35.634714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:35.636362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:35.961243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:35.970263 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-19cfb239-0a25-4f12-9d40-1e34909d60e4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.391428 Jul 18 14:09:35.981370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 81/175] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:35 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:36.794249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:36.794921 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:36.796981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=82 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:36.802658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:36.803170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:36.804104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:36.804611 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:36.830667 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Going to try to terminate instance {{(pid=117845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:09:36.927075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-412758f7-ba92-4b51-a450-959b6ff7a359 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "DELETE /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 204 len: 0 microversion: 2.1 time: 0.140255 Jul 18 14:09:36.927904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 95/176] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:09:36 2022] DELETE /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:09:36.939214 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:36.941871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:36.945895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=79 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:36.954496 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:36.955173 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:36.956117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:36.956552 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:36.990013 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:36.990705 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:36.997673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:36.998353 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:36.999292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:36.999879 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:37.300572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:37.311807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c57ea7db-7b79-4e0c-a50c-fc422fa362d3 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1553 microversion: 2.1 time: 0.377485 Jul 18 14:09:37.312649 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 82/177] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:36 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1553 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:37.319246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:37.327229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-59b6e894-ad77-4d50-ba2c-041385687294 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.341297 Jul 18 14:09:37.327810 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 96/178] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:36 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:38.330870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:38.331540 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:38.346815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:38.347267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:38.348064 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:38.348502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:38.350494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:38.351095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:38.359161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:38.359834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:38.360696 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:38.361128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:38.579399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:38.582646 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:38.588264 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a65f6c09-6a23-4121-82d1-9a801fbdc76e tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1553 microversion: 2.1 time: 0.262483 Jul 18 14:09:38.588843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 83/179] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:38 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1553 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:38.592093 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-23331f76-50fe-44e4-9099-89d60d0af3c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.247187 Jul 18 14:09:38.593161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 97/180] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:38 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:39.605693 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:39.606297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:39.608819 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:39.609487 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:39.617173 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.617622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.618406 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.618834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.619409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.620475 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.622691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:39.623227 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:39.926366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:39.934966 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-acfea2ba-df38-4548-82df-32a795cf4a66 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1553 microversion: 2.1 time: 0.333260 Jul 18 14:09:39.945348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 84/181] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:39 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1553 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:39.974539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:39.985148 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9fae2df7-c9d3-499d-ae5a-453f37db00d1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.380112 Jul 18 14:09:39.985725 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 98/182] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:39 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:40.907626 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-22bc9952-d942-4b2f-a8ac-0c234d881f2f req-56c26392-1ee1-45a6-9bb1-9643f0054616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81682a07-6e29-4bb9-bf6a-0ecad30d6ba2", "name": "network-vif-deleted", "tag": "16a375c2-18fc-4790-abd2-72e134cdb799"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:40.923395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-22bc9952-d942-4b2f-a8ac-0c234d881f2f req-56c26392-1ee1-45a6-9bb1-9643f0054616 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:40.923847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-22bc9952-d942-4b2f-a8ac-0c234d881f2f req-56c26392-1ee1-45a6-9bb1-9643f0054616 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:40.936456 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-22bc9952-d942-4b2f-a8ac-0c234d881f2f req-56c26392-1ee1-45a6-9bb1-9643f0054616 service nova] Creating event network-vif-deleted:16a375c2-18fc-4790-abd2-72e134cdb799 for instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 on hv-cinder-84984 Jul 18 14:09:40.954809 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:40.955419 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:40.964999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-22bc9952-d942-4b2f-a8ac-0c234d881f2f req-56c26392-1ee1-45a6-9bb1-9643f0054616 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060044 Jul 18 14:09:40.966897 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:40.967594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:40.968926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:40.969362 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:40.969604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 85/183] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:41.005251 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:41.006145 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:41.014924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:41.015652 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:41.016711 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:41.017346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:41.091377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:41.099668 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6df49af0-e459-4ce1-a93d-78321a431fbd tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1345 microversion: 2.1 time: 0.149091 Jul 18 14:09:41.100446 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 99/184] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:40 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:41.208108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:41.216295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e66205a2-7ad7-44bd-a602-7f1a03632b7b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.215699 Jul 18 14:09:41.216871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 86/185] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:40 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:42.116292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:42.116924 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:42.123653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:42.124144 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:42.124931 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:42.125370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:42.170548 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:42.170992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:42.171627 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lazy-loading 'fault' on Instance uuid 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:09:42.222586 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226d34540e464a93aa984ff59b497450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dde59367144af9f1f8cce1cb7d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:42.232568 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3325f78a-299f-40ba-a5bc-2de5ce384a30 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 200 len: 1350 microversion: 2.1 time: 0.119831 Jul 18 14:09:42.233268 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 100/186] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:42 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:42.234213 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:42.235094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:42.242774 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:42.243314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:42.244500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:42.245071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:42.406054 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:42.415019 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-437aeeae-8570-47f2-a034-93ed2809cbf4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.185894 Jul 18 14:09:42.415598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 87/187] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:42 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:43.254350 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:43.255068 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:43.262256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.262807 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.263632 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.264110 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.278094 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] HTTP exception thrown: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.281320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2035567297", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "networks": [{"uuid": "4bde0255-5a3f-47b3-9352-0e55a47d42ba"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Request method failure captured: Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 HTTP/1.1 Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wlp82nMiVtGXjqLlsS6lgXf8YhOY83AyuxAfGu6lIb6MDO1ChxI7rrw6rULo0CnG1NtTmHL8LeAyMa7wp1r2O6Rh0YhNZQ_7ZO71FxDP328RQb2qwMzmsa4uPu5n_TCIsJHZ5Q6z-BjXxyNaD2rHKk2IWxnhi6QcXBI8SNqhrT57VA Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:09:43.282679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_799dde59367144af9f1f8cce1cb7d435"}]}] Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 226d34540e464a93aa984ff59b497450 Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.284083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '81682a07-6e29-4bb9-bf6a-0ecad30d6ba2'} Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:43.284886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.286006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.287023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Returning 404 to user: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:43.287023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d937963a-e328-4403-a0e3-0fc5f237edf7 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 404 len: 111 microversion: 2.1 time: 0.033595 Jul 18 14:09:43.287023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 101/188] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:43 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:09:43.336502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] validate_networks() for [('4bde0255-5a3f-47b3-9352-0e55a47d42ba', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:09:43.389807 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:43.390797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:43.397057 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.397501 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.398441 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.399055 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.413899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] HTTP exception thrown: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Request method failure captured: Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2/os-volume_attachments HTTP/1.1 Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wlp82nMiVtGXjqLlsS6lgXf8YhOY83AyuxAfGu6lIb6MDO1ChxI7rrw6rULo0CnG1NtTmHL8LeAyMa7wp1r2O6Rh0YhNZQ_7ZO71FxDP328RQb2qwMzmsa4uPu5n_TCIsJHZ5Q6z-BjXxyNaD2rHKk2IWxnhi6QcXBI8SNqhrT57VA Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:09:43.415719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_799dde59367144af9f1f8cce1cb7d435"}]}] Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 226d34540e464a93aa984ff59b497450 Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.417199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'server_id': '81682a07-6e29-4bb9-bf6a-0ecad30d6ba2'} Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:43.417989 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:43.419387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:43.420664 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Returning 404 to user: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:43.420664 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-25af7281-6d62-4c17-9d2c-0ef1e9e00242 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031557 Jul 18 14:09:43.420664 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 102/189] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:09:43 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:09:43.431954 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:43.432755 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:43.438906 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.439576 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.440628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.441061 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.664256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:43.671757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5d006b6b-be2e-47b6-8075-979e0502cadc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.244252 Jul 18 14:09:43.672369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 103/190] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:43 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:43.776450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:09:43.776873 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:09:43.777341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:09:43.777784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:09:43.778342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:09:43.787903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.788402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.789191 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:43.789617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:43.806156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Getting quotas for project 9f6e581c160d4e64a81e0b35907cc078. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:09:43.810039 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Getting quotas for user da8ecff90e714e4e961f8a8104143f62 and project 9f6e581c160d4e64a81e0b35907cc078. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:09:43.820919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:09:43.823115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:09:43.866494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-59217b9d-cbba-4657-b084-1d59467c9ed7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588864 Jul 18 14:09:43.867129 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 88/191] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 14:09:43.877072 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-618a6097-ea0e-40d8-8953-00767f428fa3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:43.877682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-618a6097-ea0e-40d8-8953-00767f428fa3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:43.931183 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-618a6097-ea0e-40d8-8953-00767f428fa3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:43.938133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-618a6097-ea0e-40d8-8953-00767f428fa3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1219 microversion: 2.1 time: 0.064913 Jul 18 14:09:43.938699 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 104/192] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:43 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:44.645138 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:44.645735 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:44.652507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.652912 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.653834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.654308 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.668079 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] HTTP exception thrown: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Request method failure captured: Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 HTTP/1.1 Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wlp82nMiVtGXjqLlsS6lgXf8YhOY83AyuxAfGu6lIb6MDO1ChxI7rrw6rULo0CnG1NtTmHL8LeAyMa7wp1r2O6Rh0YhNZQ_7ZO71FxDP328RQb2qwMzmsa4uPu5n_TCIsJHZ5Q6z-BjXxyNaD2rHKk2IWxnhi6QcXBI8SNqhrT57VA Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:09:44.672605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_799dde59367144af9f1f8cce1cb7d435"}]}] Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 226d34540e464a93aa984ff59b497450 Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.673951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '81682a07-6e29-4bb9-bf6a-0ecad30d6ba2'} Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:44.674704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.676016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.677171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Returning 404 to user: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:44.677171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8e169565-99ee-4ca3-92ae-517051a1e8db tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "DELETE /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 404 len: 111 microversion: 2.1 time: 0.032692 Jul 18 14:09:44.677171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 89/193] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:09:44 2022] DELETE /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:09:44.682489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:44.683092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] [instance: 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:44.689310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:44.689908 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:44.692254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.693155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.693677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.694312 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.696354 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.696795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.697540 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.697962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.714037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] HTTP exception thrown: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Request method failure captured: Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 HTTP/1.1 Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wlp82nMiVtGXjqLlsS6lgXf8YhOY83AyuxAfGu6lIb6MDO1ChxI7rrw6rULo0CnG1NtTmHL8LeAyMa7wp1r2O6Rh0YhNZQ_7ZO71FxDP328RQb2qwMzmsa4uPu5n_TCIsJHZ5Q6z-BjXxyNaD2rHKk2IWxnhi6QcXBI8SNqhrT57VA Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:09:44.715571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/799dde59367144af9f1f8cce1cb7d435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_799dde59367144af9f1f8cce1cb7d435"}]}] Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 799dde59367144af9f1f8cce1cb7d435 Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-DeleteServersTestJSON-1983837408 Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 226d34540e464a93aa984ff59b497450 Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-DeleteServersTestJSON-1983837408-project Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.717003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '81682a07-6e29-4bb9-bf6a-0ecad30d6ba2'} Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:09:44.717702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. Jul 18 14:09:44.718770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:09:44.720968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] Returning 404 to user: Instance 81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:09:44.722040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-83675615-73d3-4086-8057-9c07a60573c1 tempest-DeleteServersTestJSON-1983837408 tempest-DeleteServersTestJSON-1983837408-project] 10.222.0.94 "GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2" status: 404 len: 111 microversion: 2.1 time: 0.043391 Jul 18 14:09:44.722805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 105/194] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:44 2022] GET /compute/v2.1/servers/81682a07-6e29-4bb9-bf6a-0ecad30d6ba2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:09:44.844085 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:44.852416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f1574b99-4b18-4bdd-9a44-e10b1c980bb3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.167006 Jul 18 14:09:44.852994 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 90/195] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:44 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:44.965490 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:44.967083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:44.981416 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.981856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:44.983810 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:44.984440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:45.086533 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:45.096292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:45.112699 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6bf571a2-4fd4-4c25-8003-a6ce2aac7a44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1279 microversion: 2.1 time: 0.158122 Jul 18 14:09:45.113398 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 106/196] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:44 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:45.870926 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:45.872213 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:45.884604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:45.887981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:45.892817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:45.893358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:46.133386 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:46.134156 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:46.144016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:46.144621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:46.145515 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:46.146090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:46.187774 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:46.195893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-717466d8-feb3-4a8e-bb62-7188c6a65200 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.329006 Jul 18 14:09:46.204026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 91/197] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:45 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:46.353193 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:46.365628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-676f0fb8-d526-45b0-8895-877c4728653d tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.238189 Jul 18 14:09:46.366230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 107/198] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:46 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:46.888987 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-b740c065-7aa9-4d42-a0be-849cea4634b6 req-dcdbb094-9e5b-4df3-9894-cec7a1a74a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a3c06e-1c78-4d8a-ad1f-b370fc8655bc", "tag": "c018dd1c-f83e-4569-ac2c-144655327803"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:46.900686 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b740c065-7aa9-4d42-a0be-849cea4634b6 req-dcdbb094-9e5b-4df3-9894-cec7a1a74a76 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:46.901572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b740c065-7aa9-4d42-a0be-849cea4634b6 req-dcdbb094-9e5b-4df3-9894-cec7a1a74a76 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:46.918440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-b740c065-7aa9-4d42-a0be-849cea4634b6 req-dcdbb094-9e5b-4df3-9894-cec7a1a74a76 service nova] Creating event network-changed:c018dd1c-f83e-4569-ac2c-144655327803 for instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc on hv-cinder-84984 Jul 18 14:09:46.939010 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-b740c065-7aa9-4d42-a0be-849cea4634b6 req-dcdbb094-9e5b-4df3-9894-cec7a1a74a76 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053497 Jul 18 14:09:46.940499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 92/199] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:47.213352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:47.214565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:47.221050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:47.221728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:47.222682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:47.223274 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:47.385802 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:47.387245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:47.399668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:47.400504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:47.401522 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:47.402142 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:47.467311 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:47.498816 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c0fe9100-d8dc-4193-a8d4-30b7e207aac7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.289370 Jul 18 14:09:47.511712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 108/200] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:47 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:47.658337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:47.672032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-650768bc-12a8-4ace-9b7f-e96ecfd0f824 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.290961 Jul 18 14:09:47.672032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 93/201] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:47 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:48.522480 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:48.525714 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:48.539823 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.540297 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.541073 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.541518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.690916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:48.691103 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:48.692796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:48.699767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bb57b3d3-af25-4488-b4c4-c50f5a11661c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.186559 Jul 18 14:09:48.700929 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.702246 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.703319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:48.704189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:48.710495 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 109/202] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:48 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:48.860945 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:48.870486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ca345f9d-f266-4cca-865a-6b6623c7c4ba tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.184509 Jul 18 14:09:48.881185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 94/203] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:48 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:49.719101 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:49.719763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:49.726970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:49.727405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:49.728473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:49.729084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:49.864472 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:49.872413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d534142d-5f10-4ffb-bbe5-cbfc7ec59809 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.159009 Jul 18 14:09:49.883232 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 110/204] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:49 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:49.889910 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:49.890665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:49.897934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:49.898846 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:49.899623 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:49.900066 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:50.050348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:50.058866 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bf775eae-aa17-4c3f-a29f-8444e028526a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.173759 Jul 18 14:09:50.059426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 95/205] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:49 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:50.891850 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:50.892539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:50.913046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:50.913757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:50.914474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:50.914900 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:51.077938 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:51.078774 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:51.086186 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:51.086700 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:51.087476 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:51.087908 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:51.101458 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:51.107513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:51.110520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dfbd1cc7-cfc7-460b-8116-0319d76d83a4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.223424 Jul 18 14:09:51.111359 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 111/206] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:50 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:51.234229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:51.246040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-33071d5d-a2b3-4026-8b09-67df3ebe7a1c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.173156 Jul 18 14:09:51.252847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 96/207] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:51 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:52.127833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:52.129261 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:52.143180 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.143861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.144831 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.145749 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.264504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:52.265853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:52.281121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.281746 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.282774 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:52.283714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:52.349838 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:52.357735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bbd939a3-db13-4954-9f65-69b125b29ad4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.233912 Jul 18 14:09:52.359637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 112/208] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:52 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:52.466557 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:52.475389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7b5ffd8c-939e-415e-a86d-d07bd9c7ab84 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.216031 Jul 18 14:09:52.476299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 97/209] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:52 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:53.376638 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:53.377247 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:53.383853 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:53.384352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:53.385159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:53.385586 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:53.493158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:53.493945 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:53.500516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:53.501112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:53.502342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:53.502929 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:53.527128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:53.536374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-20db844d-2bd9-469e-ad84-559ea9bd375f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.162085 Jul 18 14:09:53.536374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 113/210] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:53 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:53.661591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:53.670188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-18f6ee6a-b0d2-4d2a-9d28-7411cef2e41b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.181811 Jul 18 14:09:53.670770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 98/211] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:53 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:54.552283 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:54.552844 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:54.554685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:54.560321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:54.560771 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:54.561537 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:54.562043 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:54.686869 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:54.687486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:54.689427 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:54.690342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:54.696797 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:54.697249 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:54.698025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:54.698461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:54.712150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:54.720402 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d7ef4e4c-0937-484d-87ff-2cb364bd7474 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.172076 Jul 18 14:09:54.720985 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 114/212] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:54 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:54.825972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:54.833304 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e8637c2a-cfaf-4f41-9e76-832eebb344c2 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.150200 Jul 18 14:09:54.834535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 99/213] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:54 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:55.737719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:55.738337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:55.746333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:55.747029 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:55.747810 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:55.748354 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:55.850561 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:55.851174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:55.857033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:55.857477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:55.858235 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:55.858663 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:55.881868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:55.890309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2aa9fb35-ee52-4f5c-9dfd-8f2480efcf32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.156316 Jul 18 14:09:55.890946 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 115/214] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:55 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:55.985002 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:55.992718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-264f9321-5f9b-47c6-b498-870216545882 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.146087 Jul 18 14:09:55.993277 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 100/215] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:55 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:56.907871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:56.908574 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:56.916093 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:56.916536 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:56.917298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:56.917713 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:57.009411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:57.009928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:57.015861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:57.016352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:57.017103 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:57.017527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:57.044355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:57.051871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2e98e80e-453c-4bca-b42b-b3f05f23f6f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.147911 Jul 18 14:09:57.053299 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 116/216] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:56 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:57.146676 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:57.153982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c97b845d-ce55-40c7-b381-004767395046 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.148562 Jul 18 14:09:57.154545 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 101/217] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:57 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:57.623045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-af834f7a-9581-490d-afec-9ca76a47cce4 req-7772320c-8346-4d1f-a58b-0c74444d4c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a3c06e-1c78-4d8a-ad1f-b370fc8655bc", "name": "network-vif-plugged", "status": "completed", "tag": "c018dd1c-f83e-4569-ac2c-144655327803"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:09:57.632067 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-af834f7a-9581-490d-afec-9ca76a47cce4 req-7772320c-8346-4d1f-a58b-0c74444d4c99 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:57.632419 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-af834f7a-9581-490d-afec-9ca76a47cce4 req-7772320c-8346-4d1f-a58b-0c74444d4c99 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:57.643735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-af834f7a-9581-490d-afec-9ca76a47cce4 req-7772320c-8346-4d1f-a58b-0c74444d4c99 service nova] Creating event network-vif-plugged:c018dd1c-f83e-4569-ac2c-144655327803 for instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc on hv-cinder-84984 Jul 18 14:09:57.649368 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-af834f7a-9581-490d-afec-9ca76a47cce4 req-7772320c-8346-4d1f-a58b-0c74444d4c99 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030482 Jul 18 14:09:57.650201 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 117/218] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:09:58.069390 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:58.070529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:58.076625 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:58.077075 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:58.077841 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:58.078270 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:58.171405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:58.172123 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:58.178788 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:58.179234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:58.180020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:58.180450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:58.209978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:58.217547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-571f94df-65d1-4096-946b-8c161908429a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.152504 Jul 18 14:09:58.218123 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 102/219] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:58 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:58.312004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:58.319735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-751108be-85fc-4776-abc9-bee775bebc6b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.152856 Jul 18 14:09:58.320331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 118/220] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:58 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:09:59.236556 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:59.237198 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:59.243209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:59.243648 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:59.244442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:59.244877 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:59.337170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:09:59.337783 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:09:59.344253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:59.344700 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:59.345465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:09:59.345901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:09:59.375860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:59.384061 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9417ad9b-5373-44b5-bd1c-3b6eb97538db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.151321 Jul 18 14:09:59.384682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 103/221] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:59 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:09:59.482620 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:09:59.490524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6d40f219-a219-47bb-bb00-cbd15559717e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.157682 Jul 18 14:09:59.491084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 119/222] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:09:59 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:00.126316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-665404940", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "networks": [{"uuid": "5cc6197f-2206-41dd-b62d-9fbf3e29d0ea"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:00.177733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] validate_networks() for [('5cc6197f-2206-41dd-b62d-9fbf3e29d0ea', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:10:00.400806 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:00.401409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:00.407769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.408252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:00.409020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.409452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:00.586488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:10:00.586949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:10:00.587376 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:10:00.587784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:10:00.588224 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:10:00.597301 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.597972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:00.599341 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.599804 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:00.602831 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:00.610427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ca6f32dd-5fd3-478b-b8a5-5a28bb328afe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.213443 Jul 18 14:10:00.611086 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 120/223] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:00 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:00.615587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:00.616283 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:00.618645 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Getting quotas for project 2e0380aba6504b61af9e82a6a72d0211. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:10:00.621972 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.622488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:00.622894 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Getting quotas for user 936b6d72268244d09c079532a24a969c and project 2e0380aba6504b61af9e82a6a72d0211. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:10:00.623370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:00.623872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:00.634419 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:10:00.636703 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:10:00.685363 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-34ddff47-8175-495f-8afe-1d593fe65198 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562704 Jul 18 14:10:00.686104 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 104/224] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:10:00.696207 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c7356c02-b661-4c07-960b-094b0cc03b03 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:00.696817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c7356c02-b661-4c07-960b-094b0cc03b03 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:00.772125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c7356c02-b661-4c07-960b-094b0cc03b03 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:00.781954 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c7356c02-b661-4c07-960b-094b0cc03b03 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1213 microversion: 2.1 time: 0.089880 Jul 18 14:10:00.782671 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 105/225] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:00 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:00.788587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:00.796029 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6d9b7403-20a9-4ab8-b279-33f6aa199e70 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.183897 Jul 18 14:10:00.796605 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 121/226] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:00 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:01.626922 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:01.627532 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:01.634157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:01.634592 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.635592 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:01.636051 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.764235 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:01.771598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cd5d25e6-ed5f-45ee-9cbb-aa85e7e77804 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.148772 Jul 18 14:10:01.772188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 106/227] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:01 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:01.798424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:01.799067 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:01.806045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:01.806489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.807252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:01.807692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.812501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:01.813143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:01.820056 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:01.820510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.821281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:01.821714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:01.882748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:01.890128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3f1e4fe6-a545-458b-892a-2d4695e077c2 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1217 microversion: 2.1 time: 0.095441 Jul 18 14:10:01.890734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 122/228] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:01 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:01.970565 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:01.977874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-79d93606-d567-4d33-9350-5a07f80907c7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.169059 Jul 18 14:10:01.978437 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 107/229] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:01 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:02.788270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:02.788866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:02.795027 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.795465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.796242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.796669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.906484 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:02.907298 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:02.913247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.913685 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.914443 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.914868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.933494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:02.941956 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-af26fc0a-a50f-4f67-99d8-f17af7323f6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.158090 Jul 18 14:10:02.943430 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 123/230] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:02 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:02.983351 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:02.991365 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-95d1d503-bada-468e-bb88-0806baf4b776 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1217 microversion: 2.1 time: 0.088639 Jul 18 14:10:02.991918 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 108/231] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:02 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:02.994563 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:02.995200 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:03.001808 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.002244 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:03.003308 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.003744 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:03.008265 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=100 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:03.130389 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:03.138392 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3634b1ee-4489-4586-b379-22cdaf9bba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1319 microversion: 2.1 time: 0.147707 Jul 18 14:10:03.138960 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 124/232] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:02 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:03.958513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:03.959120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:03.965346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.965792 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:03.966591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:03.967018 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:04.008372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:04.008985 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:04.015531 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:04.015969 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:04.016747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:04.017176 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:04.088637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:04.096121 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d7f639a2-1724-414a-ae7f-5ee7512e3faf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1209 microversion: 2.1 time: 0.092590 Jul 18 14:10:04.096688 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 125/233] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:04 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:04.120706 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:04.128288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-44d504d3-1a6a-4d07-bcca-e48a56604fc7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.173562 Jul 18 14:10:04.128849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 109/234] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:03 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:04.155908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:04.156563 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:04.162723 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:04.163196 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:04.163971 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:04.164400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:04.296370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:04.308852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-035c1f43-05bc-413c-9679-e674f602a022 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1509 microversion: 2.1 time: 0.156873 Jul 18 14:10:04.309388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 126/235] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:04 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:05.113706 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:05.114624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:05.120991 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:05.121528 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:05.122374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:05.122874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:05.147106 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:05.148533 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:05.159979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:05.160442 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:05.161747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:05.162198 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:05.416618 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:05.427182 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7d288d59-7bb8-421c-a514-e83c51071a8c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1271 microversion: 2.1 time: 0.316916 Jul 18 14:10:05.436029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 110/236] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:05 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:05.609794 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:05.618843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-198ebf4b-88f2-4078-b305-1adfe95ea691 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.476743 Jul 18 14:10:05.619658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 127/237] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:05 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:06.448180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:06.449156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:06.457489 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:06.458836 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:06.459888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:06.461670 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:06.637210 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:06.637812 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:06.645339 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:06.645801 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:06.646901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:06.647359 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:06.744734 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:06.756975 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b06aaf6-000b-48a2-8c58-d8a0c5481b48 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.313382 Jul 18 14:10:06.758173 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 111/238] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:06 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:06.886885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:06.894902 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-34e2ad65-917f-43fa-9c0b-0fdab19217e9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.262583 Jul 18 14:10:06.896144 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 128/239] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:06 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:06.907134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-677fd31a-6f21-435e-81fe-26949de90b97 req-9183471f-7af0-4e35-b90a-bbf707cdd3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b11fda1-dc66-4cd1-8289-e5aa8f02f414", "tag": "60cea59e-57a3-4619-84ed-8b7a9dbc4c00"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:06.915798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-677fd31a-6f21-435e-81fe-26949de90b97 req-9183471f-7af0-4e35-b90a-bbf707cdd3c7 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:06.919363 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-677fd31a-6f21-435e-81fe-26949de90b97 req-9183471f-7af0-4e35-b90a-bbf707cdd3c7 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:06.938562 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-677fd31a-6f21-435e-81fe-26949de90b97 req-9183471f-7af0-4e35-b90a-bbf707cdd3c7 service nova] Creating event network-changed:60cea59e-57a3-4619-84ed-8b7a9dbc4c00 for instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 on hv-cinder-84984 Jul 18 14:10:06.945899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-677fd31a-6f21-435e-81fe-26949de90b97 req-9183471f-7af0-4e35-b90a-bbf707cdd3c7 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042387 Jul 18 14:10:06.947133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 112/240] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:07.775043 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:07.775653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:07.777976 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:07.783229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:07.783682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:07.784799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:07.785211 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:07.913225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:07.914482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:07.916453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:07.922770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:07.923225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:07.924022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:07.924455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:07.928794 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:07.936137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-70766b90-7dff-4dae-ba7b-cb2ea666d369 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.164847 Jul 18 14:10:07.936665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 129/241] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:07 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:08.069422 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:08.076802 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4f3da420-464e-4a77-98b3-a8d69fbfc465 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.168927 Jul 18 14:10:08.077358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 113/242] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:07 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:08.954141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:08.955251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:08.962504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:08.962952 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:08.963910 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:08.964366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:09.094032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:09.095139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:09.103961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:09.104434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:09.106903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:09.108734 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:09.156156 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:09.164108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6f8fe51a-b6c8-4a43-8659-e3c7023d5dde tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.215048 Jul 18 14:10:09.164713 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 130/243] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:08 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:09.272150 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:09.279923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4bd35314-c3d9-48b2-b9ab-cc7d4f46c331 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.189637 Jul 18 14:10:09.280523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 114/244] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:09 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:10.181017 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:10.181823 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:10.188936 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:10.189635 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:10.190420 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:10.190846 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:10.298604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:10.299409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:10.310175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:10.310628 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:10.311409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:10.311834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:10.327639 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:10.332317 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:10.336125 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d1994dbf-76ed-4894-ae4b-21c1e741fa27 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.158967 Jul 18 14:10:10.336692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 131/245] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:10 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:10.446406 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:10.454720 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3e24b132-aee6-4c0d-99e2-bad1a3d41efb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.160552 Jul 18 14:10:10.455490 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 115/246] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:10 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:11.352755 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:11.353380 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:11.360239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:11.360710 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:11.361645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:11.362075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:11.473475 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:11.474200 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:11.476161 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:11.476993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=8 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:11.482788 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:11.483251 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:11.484058 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:11.484480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:11.491201 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:11.498548 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-641eaadb-9351-4570-8efa-1fc9b4369b16 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.149606 Jul 18 14:10:11.499116 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 132/247] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:11 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:11.614705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:11.622197 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7c1adff6-5096-4984-9efb-5c59ee45ace8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.152550 Jul 18 14:10:11.622796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 116/248] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:11 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:12.515776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:12.516317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:12.522770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:12.523237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:12.524006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:12.524431 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:12.639901 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:12.640895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:12.647239 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:12.647761 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:12.648653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:12.649158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:12.652830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:12.660096 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fad2b5ec-3252-405c-98ae-faed29769fcf tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.148072 Jul 18 14:10:12.661205 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 133/249] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:12 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:12.776280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:12.783714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-91af1ee8-dbda-48d6-9fc1-55b0d1779b19 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.148143 Jul 18 14:10:12.784316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 117/250] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:12 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:13.678004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:13.678687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:13.685499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:13.685942 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:13.686709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:13.687134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:13.800634 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:13.801748 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:13.807653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:13.808133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:13.808903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:13.809333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:13.819106 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:13.826417 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bee7a296-9652-489a-8dd9-d1dfc0933f0f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.153041 Jul 18 14:10:13.826994 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 134/251] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:13 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:13.937495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:13.945869 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f505a828-61ca-4d5b-aa9f-4bec9616d623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.149073 Jul 18 14:10:13.946441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 118/252] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:13 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:14.843811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:14.844366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:14.851409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:14.851888 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:14.852713 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:14.853156 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:14.962991 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:14.964432 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:14.971799 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:14.972360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:14.973833 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:14.974667 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:15.189037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:15.193196 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:15.199259 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9b77daab-6cd6-4f1f-afe8-82cc45ec57fb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.359377 Jul 18 14:10:15.200082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 135/253] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:14 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:15.200711 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-64ca43f4-51f2-4a2e-885d-902c6fb8f9b5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.241887 Jul 18 14:10:15.201423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 119/254] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:14 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:16.216083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:16.216682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:16.217009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:16.217617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:16.223419 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.223567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.223860 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.224053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.224717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.224826 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:16.225143 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.225244 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:16.430327 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:16.434882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:16.438703 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6caff883-ea85-48e3-aef4-7f3432b76957 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.226485 Jul 18 14:10:16.439759 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 136/255] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:16 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:16.443257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8ae6454c-89bd-457b-a383-9d13823fdda9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.229926 Jul 18 14:10:16.443927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 120/256] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:16 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:17.455904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:17.456529 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:17.460619 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:17.461255 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:17.464159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:17.464637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:17.465483 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:17.465915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:17.467574 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:17.468108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:17.468916 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:17.469390 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:17.664105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:17.668703 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:17.671500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-83aebea2-812f-4214-a980-0c48e63e94aa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.219421 Jul 18 14:10:17.672094 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 137/257] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:17 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:17.677092 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-42bf8c09-c2dc-4cea-b2ac-0d88a2a96143 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.221066 Jul 18 14:10:17.677834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 121/258] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:17 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:18.688541 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:18.689436 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:18.695218 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:18.696032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:18.696522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:18.696967 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:18.697735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:18.698166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:18.702510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:18.703049 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:18.703932 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:18.704411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:18.898028 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:18.901523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:18.905644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-176bf66b-1899-4634-b6aa-4797a1eb260d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.221033 Jul 18 14:10:18.906307 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 138/259] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:18 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:18.908766 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1050b76d-6177-432b-b6f4-4a87eee316d9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.217923 Jul 18 14:10:18.909362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 122/260] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:18 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:19.922334 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:19.922944 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:19.925133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:19.925780 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:19.929605 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:19.930053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:19.930855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:19.931286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:19.931804 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:19.932290 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:19.933053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:19.933486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:20.127632 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:20.132330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:20.135700 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-22234eb6-25a0-41f7-a1f0-b8a95b16c43b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.217238 Jul 18 14:10:20.136308 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 139/261] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:19 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:20.140113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4b6a65a4-ec80-403e-9a9e-3d2fdbeec553 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.218711 Jul 18 14:10:20.140672 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 123/262] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:19 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:21.154269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:21.154863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:21.157668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:21.158278 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:21.162163 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.162608 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.163376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.163804 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.165758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.166371 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.167398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.168008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.373146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:21.375559 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=100 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:21.377020 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:21.384517 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-83c0a339-ea7a-4226-86e3-419050f7b3f0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.234007 Jul 18 14:10:21.385428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 140/263] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:21 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:21.386220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-02bf0ff7-dbf7-4b65-883d-a63b596c2eb0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.232534 Jul 18 14:10:21.386941 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 124/264] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:21 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:21.444327 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-baa27105-717a-416e-901f-86a96f5c9fb1 req-b69cd3fa-4a71-4133-95d1-7a3fcb024c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b11fda1-dc66-4cd1-8289-e5aa8f02f414", "name": "network-vif-plugged", "status": "completed", "tag": "60cea59e-57a3-4619-84ed-8b7a9dbc4c00"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:21.454766 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-baa27105-717a-416e-901f-86a96f5c9fb1 req-b69cd3fa-4a71-4133-95d1-7a3fcb024c21 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:21.455286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-baa27105-717a-416e-901f-86a96f5c9fb1 req-b69cd3fa-4a71-4133-95d1-7a3fcb024c21 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:21.470203 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-baa27105-717a-416e-901f-86a96f5c9fb1 req-b69cd3fa-4a71-4133-95d1-7a3fcb024c21 service nova] Creating event network-vif-plugged:60cea59e-57a3-4619-84ed-8b7a9dbc4c00 for instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 on hv-cinder-84984 Jul 18 14:10:21.476864 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-baa27105-717a-416e-901f-86a96f5c9fb1 req-b69cd3fa-4a71-4133-95d1-7a3fcb024c21 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036036 Jul 18 14:10:21.477539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 141/265] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:22.404230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:22.405636 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:22.412955 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:22.413900 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:22.415050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:22.415485 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:22.417542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:22.422737 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:22.433811 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:22.434683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:22.436316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:22.437864 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:23.118438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:23.125879 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ecadd4e5-5b47-4122-8410-9a734addbb23 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.726560 Jul 18 14:10:23.126445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 142/266] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:22 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:23.130023 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:23.140530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-807571f4-4dc5-424d-937c-9aa22bb6b9b8 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.741466 Jul 18 14:10:23.141184 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 125/267] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:22 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:24.144191 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:24.144191 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:24.152124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:24.157241 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:24.158714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:24.164611 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:24.165467 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:24.166053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:24.172797 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:24.173474 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:24.174267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:24.174701 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:24.417963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:24.421580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:24.426054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-100f1bce-9592-4aa7-bd07-806a29851b99 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1313 microversion: 2.1 time: 0.287556 Jul 18 14:10:24.426776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 143/268] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:24 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:24.429471 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c2aee121-a574-4ca1-b96c-da63e3966544 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.275929 Jul 18 14:10:24.430068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 126/269] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:24 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:25.446113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:25.448063 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:25.448237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:25.448876 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:25.455566 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.456332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.457384 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.457976 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.470236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.473104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.474497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:25.475568 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:25.692370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:25.699902 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-975fad59-796a-4eed-9549-218f40165d67 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.256239 Jul 18 14:10:25.700486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 127/270] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:25 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:25.707291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:25.717969 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9b9c3ebe-d2a4-4c2a-94ca-4fb219321c7b tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1497 microversion: 2.1 time: 0.277882 Jul 18 14:10:25.719470 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 144/271] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:25 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1497 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:26.717157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:26.717784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:26.724266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:26.724716 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:26.725461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:26.725882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:26.866256 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:26.873448 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f1f738f6-bfec-4b82-886d-071a4a8f7d46 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.160137 Jul 18 14:10:26.874007 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 128/272] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:26 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:27.895559 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:27.896314 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:27.903475 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:27.903926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:27.904720 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:27.905158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:28.038556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:28.047246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-830a97ad-1936-47e9-a829-00a5debc81ba tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.156098 Jul 18 14:10:28.047908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 145/273] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:27 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:29.065366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:29.065969 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:29.072890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:29.073334 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:29.074088 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:29.074523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:29.204825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:29.213682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f4c0cbda-d2e5-4bb1-8542-5798201fcc21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1521 microversion: 2.1 time: 0.152419 Jul 18 14:10:29.214293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 129/274] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:29 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:30.232728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:30.233393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:30.241374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:30.241971 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:30.242974 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:30.243520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:30.378866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:30.387896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-113008dc-9b47-43e4-b8a7-d9d4d980be4a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1501 microversion: 2.1 time: 0.159612 Jul 18 14:10:30.388501 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 146/275] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:30 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:30.405829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:30.406519 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:30.413002 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:30.413477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:30.414463 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:30.414900 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:30.544395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:30.553584 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9388253e-f6f0-4057-a4fb-0e8c75f6ce79 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1514 microversion: 2.1 time: 0.152024 Jul 18 14:10:30.554311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 130/276] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:30 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:31.949300 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:31.954239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:31.964848 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:31.965287 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:31.966133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:31.966789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:32.009767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Going to try to terminate instance {{(pid=117845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:10:32.094018 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-80b34dc2-1c0f-4ba4-9be5-f3db851be86f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "DELETE /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 204 len: 0 microversion: 2.1 time: 0.155246 Jul 18 14:10:32.095855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 147/277] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:10:31 2022] DELETE /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:10:32.103914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:32.105012 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:32.111978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:32.112730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:32.113580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:32.114030 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:32.266389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:32.277933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3aa35db7-0e9a-47d5-b45a-bc2651f7113d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.176741 Jul 18 14:10:32.287684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 131/278] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:32 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:33.293891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:33.294574 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:33.301166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:33.301687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:33.302442 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:33.302865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:33.434521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:33.442137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e0b7bf49-04c9-4bd0-9c1a-6b702d257ddd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.152395 Jul 18 14:10:33.442697 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 148/279] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:33 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:34.459070 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:34.459832 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:34.466684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:34.467210 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:34.468099 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:34.468639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:34.471473 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:34.606288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:34.613645 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7f1c815e-064e-437e-85f9-1981e1d26122 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.158908 Jul 18 14:10:34.615083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 132/280] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:34 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:35.633828 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:35.634565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:35.642642 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:35.643213 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:35.644170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:35.644704 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:35.778004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:35.785309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-eb5fb9a2-ceb2-4da6-b43e-c3faa59940e9 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.157129 Jul 18 14:10:35.786377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 149/281] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:35 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:36.803422 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:36.804018 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:36.810211 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:36.810649 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:36.811462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:36.811892 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:36.950749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:36.958398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aa726bfd-b08f-4e13-b1cf-10d59b6f6bdd tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.159165 Jul 18 14:10:36.958958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 133/282] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:36 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:37.975528 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:37.976090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:37.978525 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:37.983805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:37.984267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:37.985053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:37.985475 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:38.118255 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:38.125655 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7a4eb120-b8af-4718-a827-081d4c98f652 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.154665 Jul 18 14:10:38.126201 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 150/283] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:37 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:38.286789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:38.287957 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:38.289896 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=42 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:38.295449 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:38.295903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:38.296728 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:38.297161 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:38.320219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lazy-loading 'flavor' on Instance uuid 6e87ba3d-6fdc-4f00-872f-10529eae1db5 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:10:38.389807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5e6fd812-b1af-4ba5-9a5f-ed1f5a9fae9c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5/action" status: 200 len: 32 microversion: 2.1 time: 0.107646 Jul 18 14:10:38.390401 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 134/284] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:10:38 2022] POST /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5/action => generated 32 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:10:38.400027 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:38.400691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:38.406941 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:38.407435 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:38.408333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:38.408847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:38.539204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:38.547146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-463fd58e-91fd-4c86-acce-d1f9eeed8e13 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.151117 Jul 18 14:10:38.547713 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 151/285] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:38 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:39.144388 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:39.145090 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:39.151219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:39.151667 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:39.152456 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:39.152892 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:39.282617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:39.289944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-75bf08e5-c895-44c7-b623-f6a0b96d9dc7 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.149809 Jul 18 14:10:39.290515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 135/286] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:39 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:39.563709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:39.564331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:39.570708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:39.571146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:39.571891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:39.572345 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:39.704796 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:39.712151 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5ad1d935-5bb9-4ee7-b82a-9a9cee3fd120 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.152467 Jul 18 14:10:39.712714 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 152/287] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:39 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:40.306817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:40.307348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:40.313793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:40.314238 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:40.314983 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:40.315405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:40.444704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:40.452215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1015ce89-4079-4250-bef3-7affd3d34460 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.149320 Jul 18 14:10:40.452794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 136/288] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:40 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:40.728923 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:40.729580 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:40.735908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:40.736380 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:40.737131 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:40.737553 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:40.866766 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:40.874143 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ef20f7d1-468e-4685-a2d2-ec52a991d0cc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.148997 Jul 18 14:10:40.874716 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 153/289] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:40 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:41.469796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:41.470403 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:41.477189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:41.477635 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:41.478386 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:41.478817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:41.607068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:41.615025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-35bd2e77-3822-4aca-950d-79ba36b041a4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.149049 Jul 18 14:10:41.615587 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 137/290] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:41 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:41.892250 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:41.892945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:41.899628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:41.900176 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:41.900944 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:41.901376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:42.034246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:42.042138 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4d60e472-80b3-4cde-a241-ec7595db5d4b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.154511 Jul 18 14:10:42.042692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 154/291] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:41 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:42.632352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:42.632961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:42.639110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:42.639560 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:42.640348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:42.640775 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:42.778717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:42.788438 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e7374aa7-2c86-483b-9f9c-c9755ce303f4 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.160309 Jul 18 14:10:42.798362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 138/292] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:42 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:43.059631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:43.060385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:43.067183 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:43.067636 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:43.068431 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:43.068869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:43.210269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:43.218103 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2990f9bb-e64b-424e-a0bd-00910269a7c2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.162270 Jul 18 14:10:43.218666 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 155/293] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:43 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:43.805858 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:43.806535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:43.813457 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:43.813902 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:43.814755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:43.815191 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:44.153727 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:44.162162 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4be80c3e-89d6-4164-b230-8a3c0e09d8ae tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1503 microversion: 2.1 time: 0.360178 Jul 18 14:10:44.162742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 139/294] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:43 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:44.235644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:44.236306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:44.243154 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:44.243607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:44.244410 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:44.244842 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:44.259411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:44.522740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:44.530352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7b069608-1c16-496f-a47a-9a3f7218ed3e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.298480 Jul 18 14:10:44.530918 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 156/295] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:44 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:44.748885 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-a034f809-5b90-4ffb-a204-c024e5389e4c req-d4fe6a07-df31-48da-964b-ef580d20d2a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b11fda1-dc66-4cd1-8289-e5aa8f02f414", "name": "network-vif-deleted", "tag": "60cea59e-57a3-4619-84ed-8b7a9dbc4c00"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:44.758853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-a034f809-5b90-4ffb-a204-c024e5389e4c req-d4fe6a07-df31-48da-964b-ef580d20d2a9 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:44.759298 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-a034f809-5b90-4ffb-a204-c024e5389e4c req-d4fe6a07-df31-48da-964b-ef580d20d2a9 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:44.770482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-a034f809-5b90-4ffb-a204-c024e5389e4c req-d4fe6a07-df31-48da-964b-ef580d20d2a9 service nova] Creating event network-vif-deleted:60cea59e-57a3-4619-84ed-8b7a9dbc4c00 for instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 on hv-cinder-84984 Jul 18 14:10:44.775649 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-a034f809-5b90-4ffb-a204-c024e5389e4c req-d4fe6a07-df31-48da-964b-ef580d20d2a9 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Jul 18 14:10:44.776373 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 140/296] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:45.178520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:45.179050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:45.185112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:45.185695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:45.186560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:45.187038 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:45.217318 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:45.217761 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:45.218202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lazy-loading 'fault' on Instance uuid 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:10:45.263029 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:45.270423 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-46125fc6-9f5c-43a0-84cc-85c39ef54541 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 200 len: 1303 microversion: 2.1 time: 0.095812 Jul 18 14:10:45.270985 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 157/297] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:45 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:45.547174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:45.547886 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:45.554715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:45.555154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:45.555906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:45.556461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:45.687972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:45.696666 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a00d97c4-bfb4-46d7-8b63-7e455827e157 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.153687 Jul 18 14:10:45.697234 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 141/298] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:45 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:46.287239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:46.287841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: 9b11fda1-dc66-4cd1-8289-e5aa8f02f414] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:46.294393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:46.294834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:46.295592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:46.296044 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:46.310172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] HTTP exception thrown: Instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 could not be found. Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Request method failure captured: Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 HTTP/1.1 Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WmxwJC1St_K1SZxjmxeHriEr7nGzFF76owVdQdrlYRJxPHEt0WJpW1R3LXZDzhfws_8mmjj4oeIHkI-xZOv9OeEMsx2v1FGLtRcLJ5mzub70ji1Lm5jmAAn0fGh33RPZF7BV2jnam2sn9KrUy-ZVVW6NxfnEkZHaa5Ys3rFtzewHC8 Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 2e0380aba6504b61af9e82a6a72d0211 Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesActionsTest-366194282 Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:10:46.311813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2e0380aba6504b61af9e82a6a72d0211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2e0380aba6504b61af9e82a6a72d0211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2e0380aba6504b61af9e82a6a72d0211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2e0380aba6504b61af9e82a6a72d0211"}]}] Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesActionsTest-366194282 Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 2e0380aba6504b61af9e82a6a72d0211 Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesActionsTest-366194282 Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesActionsTest-366194282-project Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 936b6d72268244d09c079532a24a969c Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesActionsTest-366194282-project Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 could not be found. Jul 18 14:10:46.313564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '9b11fda1-dc66-4cd1-8289-e5aa8f02f414'} Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 could not be found. Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:10:46.314285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 could not be found. Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 could not be found. Jul 18 14:10:46.315400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:10:46.317001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Returning 404 to user: Instance 9b11fda1-dc66-4cd1-8289-e5aa8f02f414 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:10:46.317001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8ae553b9-eb81-4d71-81a0-624a6845967e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414" status: 404 len: 111 microversion: 2.1 time: 0.029780 Jul 18 14:10:46.317001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 158/299] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:46 2022] GET /compute/v2.1/servers/9b11fda1-dc66-4cd1-8289-e5aa8f02f414 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:10:46.418055 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-739400734", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "networks": [{"uuid": "5cc6197f-2206-41dd-b62d-9fbf3e29d0ea"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:46.470462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] validate_networks() for [('5cc6197f-2206-41dd-b62d-9fbf3e29d0ea', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:10:46.714189 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:46.715108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:46.721569 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:46.722010 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:46.722807 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:46.723233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:46.872139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:10:46.873106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:10:46.873582 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:10:46.873984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:10:46.874386 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:10:46.884384 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:46.884820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:46.885604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:46.886088 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:46.900811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:46.903317 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Getting quotas for project 2e0380aba6504b61af9e82a6a72d0211. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:10:46.907297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Getting quotas for user 936b6d72268244d09c079532a24a969c and project 2e0380aba6504b61af9e82a6a72d0211. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:10:46.908619 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8cfc00f6-1053-480e-a8dc-f44971e26bbf tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.198502 Jul 18 14:10:46.909440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 159/300] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:46 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:46.927455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:10:46.929835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:10:46.975412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2f8af96b-20d4-4db2-b35d-223dee578bfb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560961 Jul 18 14:10:46.975992 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 142/301] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:10:46.985824 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-612d7792-0e08-454a-8dfa-49bb35d745ed tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:46.986439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-612d7792-0e08-454a-8dfa-49bb35d745ed tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:47.047391 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-612d7792-0e08-454a-8dfa-49bb35d745ed tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:47.056363 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-612d7792-0e08-454a-8dfa-49bb35d745ed tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1213 microversion: 2.1 time: 0.073837 Jul 18 14:10:47.057296 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 160/302] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:46 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:47.925138 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:47.925820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:47.931810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:47.932285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:47.933042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:47.933484 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:48.066025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:48.074096 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:48.074729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:48.074945 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9ff95d3d-147e-447b-942e-8124b0c2b902 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.153694 Jul 18 14:10:48.075514 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 143/303] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:47 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:48.081748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:48.082824 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:48.083615 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:48.084349 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:48.158652 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:48.166553 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bbe3b6b9-8b67-4195-b38e-94c29a7daefa tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1273 microversion: 2.1 time: 0.096227 Jul 18 14:10:48.176079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 161/304] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:48 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:49.093094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:49.093839 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:49.103501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:49.104027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:49.104793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:49.105217 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:49.191970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:49.193357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:49.200652 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:49.201115 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:49.201986 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:49.202494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:49.402155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:49.410120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-20ea402c-3d66-4c57-a201-3dd23b1e1b08 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.321156 Jul 18 14:10:49.411022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 144/305] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:49 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:49.440215 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:49.452453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4b5736fa-6756-4fea-b6f6-b024b75b6b0a tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.271330 Jul 18 14:10:49.453566 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 162/306] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:49 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:50.077429 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c169c62b-a019-4cdf-949b-7f331f9755b7 req-f815940a-90dd-4205-8e3f-013e9fbf228d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b35a1f5a-2cec-40d1-bea7-3c0b7d410f69", "tag": "9afcfc6f-56b4-4bb2-9a3e-7715cf170af2"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:10:50.087083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c169c62b-a019-4cdf-949b-7f331f9755b7 req-f815940a-90dd-4205-8e3f-013e9fbf228d service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:50.087968 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c169c62b-a019-4cdf-949b-7f331f9755b7 req-f815940a-90dd-4205-8e3f-013e9fbf228d service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:50.101756 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c169c62b-a019-4cdf-949b-7f331f9755b7 req-f815940a-90dd-4205-8e3f-013e9fbf228d service nova] Creating event network-changed:9afcfc6f-56b4-4bb2-9a3e-7715cf170af2 for instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 on hv-cinder-84984 Jul 18 14:10:50.107318 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c169c62b-a019-4cdf-949b-7f331f9755b7 req-f815940a-90dd-4205-8e3f-013e9fbf228d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033719 Jul 18 14:10:50.108109 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 145/307] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:50.429106 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:50.430008 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:50.439117 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:50.440127 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:50.441265 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:50.442625 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:50.474524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:50.476074 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:50.484978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:50.485439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:50.486223 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:50.486927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:50.730803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:50.738254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d0a9aa4d-5e88-48ef-b016-870e78654f54 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.315511 Jul 18 14:10:50.738820 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 163/308] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:50 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:50.749094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:50.757522 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7ca79e42-8ec6-4048-a8de-d416b2e6a981 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.289921 Jul 18 14:10:50.758083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 146/309] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:50 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:51.755401 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:51.756011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:51.762821 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:51.763268 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:51.764059 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:51.764519 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:51.773212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:51.773814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:51.779755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:51.780223 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:51.780974 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:51.781423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:51.967391 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:51.971520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:51.975486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-253a0b3d-40ce-4d3d-b485-5601917f4b2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.224125 Jul 18 14:10:51.976079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 164/310] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:51 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:51.979865 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3d7fcfe4-787c-4cf5-a26d-48224156170f tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.210425 Jul 18 14:10:51.980463 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 147/311] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:51 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:52.994296 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:52.994909 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:52.996820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:52.997658 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:53.001407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:53.001884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:53.002659 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:53.003253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:53.004995 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:53.005438 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:53.006355 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:53.006780 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:53.161324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:53.170236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4b15b08b-d1a8-4a78-9cb6-adc4958c3a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.180208 Jul 18 14:10:53.170810 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 165/312] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:52 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:53.284274 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:53.286584 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:53.292829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-11022bad-4312-4943-ac41-b1b794a4e31d tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.300267 Jul 18 14:10:53.293405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 148/313] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:52 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:54.186370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:54.187088 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:54.194633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:54.194850 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:54.195616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:54.196077 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:54.309532 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:54.310228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:54.318764 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:54.319297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:54.320169 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:54.320690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:54.327883 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:54.335697 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e8de3500-215e-4897-bf1d-02ef7596bb2c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.153135 Jul 18 14:10:54.336289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 166/314] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:54 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:54.452986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:54.460633 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-02419faf-6c8c-4814-9c67-e2f935ce19fc tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.155091 Jul 18 14:10:54.461181 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 149/315] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:54 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:55.352523 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:55.353136 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:55.359572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:55.360058 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:55.360827 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:55.361281 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:55.477931 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:55.479317 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:55.485631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:55.486083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:55.486860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:55.487292 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:55.493867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:55.501876 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a029416d-a561-4c11-a04b-6607f4cc0a22 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.153102 Jul 18 14:10:55.502503 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 167/316] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:55 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:55.621352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:55.629390 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-af484055-7562-43d7-b416-3b51f369a069 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.156059 Jul 18 14:10:55.629943 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 150/317] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:55 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:56.519742 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:56.520383 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:56.526965 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:56.527421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:56.528218 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:56.528653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:56.650788 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:56.651397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:56.657312 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:56.657782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:56.658549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:56.658974 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:56.666200 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:56.673793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a61e9fda-52cb-4aeb-8bf5-c4919811eec6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.158385 Jul 18 14:10:56.674455 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 168/318] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:56 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:56.789077 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:56.796358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-907c27c8-39bf-4324-a868-094c324f866e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.149347 Jul 18 14:10:56.796905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 151/319] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:56 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:10:57.691155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:57.691763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:57.693639 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:57.699256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:57.699695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:57.700551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:57.701024 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:57.814888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:57.816390 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:57.819892 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:57.820979 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:57.826683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:57.828177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:57.829179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:57.829949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:57.858358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:57.870816 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-661a6b27-2120-4dad-9834-a781b7a23898 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.184140 Jul 18 14:10:57.871898 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 169/320] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:57 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:58.045193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:58.053929 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a50280db-aa96-4fd1-87e5-f33c7635fcb6 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.243348 Jul 18 14:10:58.054704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 152/321] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:57 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:58.888959 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:58.889676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:58.897935 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:58.898374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:58.899142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:58.899572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:59.080819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:59.083474 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:10:59.099506 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:59.100430 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:59.102868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:59.103458 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:59.133233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:59.147234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-017e8152-fff7-416e-8c7a-83b9eb72dd6c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.262797 Jul 18 14:10:59.147918 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 170/322] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:58 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:10:59.407306 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:10:59.419473 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7f51edb6-dd68-4f24-8892-52bb7771cc43 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.350252 Jul 18 14:10:59.420118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 153/323] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:10:59 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:00.166176 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:00.166780 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:00.173920 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.174604 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:00.176053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.176640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:00.326793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:00.334221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-27a3eacc-49af-4827-91ac-69194f568c09 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.171865 Jul 18 14:11:00.344739 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 171/324] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:00 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:00.436948 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:00.438042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:00.460793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.464501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:00.467221 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.467867 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:00.706890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:00.716486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f7d118ec-497e-4dc0-8104-fae9ddcf8424 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.284378 Jul 18 14:11:00.717157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 154/325] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:00 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:00.837037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-241deaab-2aeb-4e52-9052-c16d389ee9ce tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d442bb49-1a4c-42f8-ace4-0438b2ae4360", "device": "/dev/sdb"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:00.838927 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-241deaab-2aeb-4e52-9052-c16d389ee9ce tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:00.847548 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-241deaab-2aeb-4e52-9052-c16d389ee9ce tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.848287 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-241deaab-2aeb-4e52-9052-c16d389ee9ce tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:00.849223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-241deaab-2aeb-4e52-9052-c16d389ee9ce tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:00.849919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-241deaab-2aeb-4e52-9052-c16d389ee9ce tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:01.358594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:01.359555 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:01.373184 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:01.373741 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:01.376785 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:01.377308 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:01.573593 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-241deaab-2aeb-4e52-9052-c16d389ee9ce tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "POST /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741589 Jul 18 14:11:01.575890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 172/326] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:11:00 2022] POST /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:01.739445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:01.740376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:01.753031 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:01.753796 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:01.754844 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:01.755514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:01.795421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:02.279486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:02.292706 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7a5855a8-67f3-4ffc-bd01-f04fbbd1675d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.940235 Jul 18 14:11:02.293289 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 155/327] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:01 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:02.407688 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:02.424190 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9f3d0df4-a2af-4b7b-b83d-ec03e1e79da0 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.688888 Jul 18 14:11:02.426484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 173/328] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:01 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:02.457299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-e8c76eac-d054-498f-9946-f7264ae091f4 req-cacd124e-e6eb-4804-897f-33ee3d52a3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35a1f5a-2cec-40d1-bea7-3c0b7d410f69", "name": "network-vif-plugged", "status": "completed", "tag": "9afcfc6f-56b4-4bb2-9a3e-7715cf170af2"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:02.481456 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e8c76eac-d054-498f-9946-f7264ae091f4 req-cacd124e-e6eb-4804-897f-33ee3d52a3ec service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:02.482096 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e8c76eac-d054-498f-9946-f7264ae091f4 req-cacd124e-e6eb-4804-897f-33ee3d52a3ec service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:02.513050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-e8c76eac-d054-498f-9946-f7264ae091f4 req-cacd124e-e6eb-4804-897f-33ee3d52a3ec service nova] Creating event network-vif-plugged:9afcfc6f-56b4-4bb2-9a3e-7715cf170af2 for instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 on hv-cinder-84984 Jul 18 14:11:02.521126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-e8c76eac-d054-498f-9946-f7264ae091f4 req-cacd124e-e6eb-4804-897f-33ee3d52a3ec service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068318 Jul 18 14:11:02.522416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 156/329] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:03.309866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:03.310538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:03.326943 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:03.328445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:03.332134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:03.332606 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:03.450670 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:03.452155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:03.459733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:03.462014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:03.462968 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:03.464672 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:03.741905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:03.750459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a732e629-e4cf-484a-9705-909afbd326eb tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.305273 Jul 18 14:11:03.752120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 157/330] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:03 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:03.782290 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:03.818344 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f9eec1f9-29c0-4474-9acc-f9d9adca5afb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.508186 Jul 18 14:11:03.818961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 174/331] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:03 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:04.783063 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:04.783687 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:04.791377 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:04.791831 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:04.794829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:04.795268 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:04.836341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:04.836848 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:04.845720 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:04.848302 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:04.849689 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:04.851373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.194734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:05.197612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:05.202507 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0269780a-a58a-4ff2-a14c-2357a59f2a28 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1500 microversion: 2.1 time: 0.369970 Jul 18 14:11:05.203075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 175/332] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:04 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1500 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:05.220027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-46e0fbf6-cc3f-4f41-afa3-6cd035762eb5 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1313 microversion: 2.1 time: 0.440686 Jul 18 14:11:05.225153 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96e747ec-3ef5-47e6-9d48-1e958ffa378c"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:05.226554 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:05.230894 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 158/333] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:04 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:05.234719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.235621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.236443 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.237016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.262434 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] HTTP exception thrown: Cannot 'attach_volume' instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 while it is in vm_state rescued Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Request method failure captured: Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: POST /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5/os-volume_attachments HTTP/1.1 Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 74 Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wlqlb5vVhBtiN9LYhex0arcXaQaWB9pkT7ZYEGOQJ-C985AGyoC8hBJzCJ66LDgRu4P1-0_9agqg5KTCCRlUoseBHZGSGYgbe1f2ZGQSvpU9y18Rpook9YYagQtQhqVlGNL2-bPawldUfT9JkIv0i4AqmdfFsqImUsVaNGlQxCVvSU Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:11:05.264165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_eaf9f75abc034491bd1b8846c05bf625"}]}] Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 3720c2225b51464abee34d05a69b9db7 Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {"volumeAttachment": {"volumeId": "96e747ec-3ef5-47e6-9d48-1e958ffa378c"}} Jul 18 14:11:05.265481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Cannot 'attach_volume' instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 while it is in vm_state rescued Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'server_id': '6e87ba3d-6fdc-4f00-872f-10529eae1db5', 'body': {'volumeAttachment': {'volumeId': '96e747ec-3ef5-47e6-9d48-1e958ffa378c'}}} Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:11:05.266242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 while it is in vm_state rescued Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:11:05.267329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:11:05.269107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:11:05.269107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:11:05.269107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 while it is in vm_state rescued Jul 18 14:11:05.269107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:05.270837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Returning 409 to user: Cannot 'attach_volume' instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 while it is in vm_state rescued {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:11:05.271930 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-71957fbe-cd43-48fe-b130-ed622fa2a87e tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051572 Jul 18 14:11:05.273125 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 176/334] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:11:05 2022] POST /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 14:11:05.281905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a2254b89-444e-4672-a1f5-971ad66d761b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:05.282420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a2254b89-444e-4672-a1f5-971ad66d761b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:05.290393 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a2254b89-444e-4672-a1f5-971ad66d761b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.291030 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a2254b89-444e-4672-a1f5-971ad66d761b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.292154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a2254b89-444e-4672-a1f5-971ad66d761b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.292751 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a2254b89-444e-4672-a1f5-971ad66d761b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.406675 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a2254b89-444e-4672-a1f5-971ad66d761b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5/action" status: 202 len: 0 microversion: 2.1 time: 0.128360 Jul 18 14:11:05.410874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 159/335] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:11:05 2022] POST /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:11:05.417770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:05.418359 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:05.425683 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.426138 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.426928 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:05.427369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:05.676233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:05.686210 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-44b4a6cc-247c-419e-9618-e7627d74365c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1508 microversion: 2.1 time: 0.272618 Jul 18 14:11:05.692341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 177/336] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:05 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:06.241897 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:06.243244 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:06.251877 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:06.252609 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:06.254873 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:06.255525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:06.505483 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:06.513904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0483eb73-243e-4230-9fad-a172c7e61921 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1498 microversion: 2.1 time: 0.279684 Jul 18 14:11:06.514550 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 160/337] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:06 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1498 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:06.708980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:06.710561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:06.728247 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:06.728830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:06.729758 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:06.730418 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:07.058564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:07.067322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fa19e765-b793-4081-9242-168daec44755 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1508 microversion: 2.1 time: 0.366083 Jul 18 14:11:07.067915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 178/338] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:06 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:07.287027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:07.288046 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:07.295020 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:07.295643 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:07.296609 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:07.297189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:07.329629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:11:07.443154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aa6a6726-fb4e-4e5f-aebd-27ab6e2f4def tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 204 len: 0 microversion: 2.1 time: 0.160072 Jul 18 14:11:07.447036 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 161/339] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:11:07 2022] DELETE /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:11:07.452541 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:07.453439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:07.461974 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:07.464300 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:07.465319 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:07.465757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:07.703022 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:07.712867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d0ef564c-2b6f-4b2b-8929-295ed2104359 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1504 microversion: 2.1 time: 0.264262 Jul 18 14:11:07.713490 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 179/340] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:07 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:08.088374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:08.090019 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:08.100280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:08.102620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:08.104694 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:08.105430 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:08.298050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:08.307669 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-875cfbf3-8fe1-411a-afb6-d4f0baefc051 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1508 microversion: 2.1 time: 0.224618 Jul 18 14:11:08.310300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 162/341] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:08 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:08.734464 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:08.735695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:08.746344 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=64 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:08.759625 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:08.762220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:08.763626 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:08.764814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:09.038370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:09.048866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cb9da343-88ac-49dc-93ce-637505aa9171 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1504 microversion: 2.1 time: 0.321493 Jul 18 14:11:09.049974 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 180/342] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:08 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:09.341612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:09.342221 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:09.344242 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:09.356153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:09.356865 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:09.357700 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:09.358129 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:09.422472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:09.687692 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:09.698125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-736d9045-d7ba-4436-a3cc-3b74196c0f8f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1508 microversion: 2.1 time: 0.361292 Jul 18 14:11:09.698691 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 163/343] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:09 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1508 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:10.072334 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:10.072334 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:10.083865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:10.084403 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:10.085270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:10.085768 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:10.522863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:10.537533 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cfb37ecc-ea42-4db4-9be0-0f09cac5288c tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1504 microversion: 2.1 time: 0.474021 Jul 18 14:11:10.540202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 181/344] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:10 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1504 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:10.716872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:10.717483 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:10.725594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:10.726300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:10.727284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:10.727689 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:10.875201 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:10.887460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-48c7e28f-dc3f-4986-932b-e81e6ded391d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1508 microversion: 2.1 time: 0.175336 Jul 18 14:11:10.888113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 164/345] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:10 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:11.012328 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-80290d6e-89b6-4559-95e4-8ea1b522f273 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Action: 'create', calling method: .version_select at 0x7f7b3b5f35e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1494975757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQmzwckRA5a1x7GQXYNILo7yb2zt0vwlmaSniTe2SAx14z9HBomSovV8AECchTrHFV2G98+KvBzI9A/gpu7Y3axb44xx9QFzRg4trTqLTDcS7/Q+98Cev2KHEEuzPLzHQ=="}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:11.028484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-80290d6e-89b6-4559-95e4-8ea1b522f273 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Getting quotas for project f618e7dff5d7411eb4d4cade50d68607. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:11:11.032701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-80290d6e-89b6-4559-95e4-8ea1b522f273 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Getting quotas for user 2aa4925080114a33b80e2ca588fbeb27 and project f618e7dff5d7411eb4d4cade50d68607. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:11:11.058053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-80290d6e-89b6-4559-95e4-8ea1b522f273 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.253322 Jul 18 14:11:11.058641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 182/346] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:11:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:11.567825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:11.568593 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:11.580958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:11.581622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:11.584220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:11.586814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:11.829309 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:11.837289 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-289963df-73f8-4e40-a893-a3391e10f970 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1504 microversion: 2.1 time: 0.274378 Jul 18 14:11:11.837851 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 165/347] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:11 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:11.905471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:11.906113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:11.912640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:11.913110 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:11.913918 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:11.914621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:12.089497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:12.098104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2d90c8bb-9481-4a38-a6f9-5895de00f7ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1514 microversion: 2.1 time: 0.196907 Jul 18 14:11:12.098678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 183/348] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:11 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:12.854110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:12.858215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:12.869620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:12.870309 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:12.871175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:12.872848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:13.070546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936b6d72268244d09c079532a24a969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0380aba6504b61af9e82a6a72d0211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:13.081105 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dbd485a2-6b66-426b-a2ff-9dc63791fa28 tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 200 len: 1504 microversion: 2.1 time: 0.228861 Jul 18 14:11:13.082086 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 166/349] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:12 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:13.246000 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-6c7bdaa7-908e-4ff5-a59b-ebb0480e6e16 req-bd60da54-c278-4ca8-91d5-09c8051e8bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b35a1f5a-2cec-40d1-bea7-3c0b7d410f69", "name": "network-vif-deleted", "tag": "9afcfc6f-56b4-4bb2-9a3e-7715cf170af2"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:13.257673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-6c7bdaa7-908e-4ff5-a59b-ebb0480e6e16 req-bd60da54-c278-4ca8-91d5-09c8051e8bc2 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:13.258324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-6c7bdaa7-908e-4ff5-a59b-ebb0480e6e16 req-bd60da54-c278-4ca8-91d5-09c8051e8bc2 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:13.273407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-6c7bdaa7-908e-4ff5-a59b-ebb0480e6e16 req-bd60da54-c278-4ca8-91d5-09c8051e8bc2 service nova] Creating event network-vif-deleted:9afcfc6f-56b4-4bb2-9a3e-7715cf170af2 for instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 on hv-cinder-84984 Jul 18 14:11:13.281090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-6c7bdaa7-908e-4ff5-a59b-ebb0480e6e16 req-bd60da54-c278-4ca8-91d5-09c8051e8bc2 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039490 Jul 18 14:11:13.284389 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 184/350] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:13.508602 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1eb1bd8e-a3bf-4e60-be2e-d4aa2f8b502c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'create', calling method: .version_select at 0x7f7b3b7ccb80>, body: {"keypair": {"name": "tempest-keypair-1019366119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a2S6/HEsM8fsBgszSEx8sAdfXNOZ1PVPmSgdciDxzPPn5QZLVQDLf+vwFvix3C4l7u/hUCcaQYO4dVU1KKAh4kZAQ2FPhnDrwWGHnpIbi/xtEUlDvE2cwgg0WvQhi6Q=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:13.529667 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-1eb1bd8e-a3bf-4e60-be2e-d4aa2f8b502c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for project eaf9f75abc034491bd1b8846c05bf625. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:11:13.535235 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-1eb1bd8e-a3bf-4e60-be2e-d4aa2f8b502c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for user 3720c2225b51464abee34d05a69b9db7 and project eaf9f75abc034491bd1b8846c05bf625. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:11:13.569020 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1eb1bd8e-a3bf-4e60-be2e-d4aa2f8b502c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064694 Jul 18 14:11:13.570177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 167/351] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:11:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:14.103475 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:14.108863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] [instance: b35a1f5a-2cec-40d1-bea7-3c0b7d410f69] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:14.127583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:14.147685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:14.148740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:14.149452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:14.180740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] HTTP exception thrown: Instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 could not be found. Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Request method failure captured: Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 HTTP/1.1 Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WmxwJC1St_K1SZxjmxeHriEr7nGzFF76owVdQdrlYRJxPHEt0WJpW1R3LXZDzhfws_8mmjj4oeIHkI-xZOv9OeEMsx2v1FGLtRcLJ5mzub70ji1Lm5jmAAn0fGh33RPZF7BV2jnam2sn9KrUy-ZVVW6NxfnEkZHaa5Ys3rFtzewHC8 Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 2e0380aba6504b61af9e82a6a72d0211 Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesActionsTest-366194282 Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:11:14.182802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/2e0380aba6504b61af9e82a6a72d0211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2e0380aba6504b61af9e82a6a72d0211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/2e0380aba6504b61af9e82a6a72d0211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_2e0380aba6504b61af9e82a6a72d0211"}]}] Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesActionsTest-366194282 Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 2e0380aba6504b61af9e82a6a72d0211 Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesActionsTest-366194282 Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesActionsTest-366194282-project Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 936b6d72268244d09c079532a24a969c Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesActionsTest-366194282-project Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 could not be found. Jul 18 14:11:14.184750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'b35a1f5a-2cec-40d1-bea7-3c0b7d410f69'} Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 could not be found. Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:11:14.185524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 could not be found. Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 could not be found. Jul 18 14:11:14.186722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:11:14.190662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] Returning 404 to user: Instance b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:11:14.190662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ee1f1a75-3016-4ac2-a8d2-8dea47a2546e tempest-VolumesActionsTest-366194282 tempest-VolumesActionsTest-366194282-project] 10.222.0.94 "GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69" status: 404 len: 111 microversion: 2.1 time: 0.090507 Jul 18 14:11:14.190662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 185/352] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:14 2022] GET /compute/v2.1/servers/b35a1f5a-2cec-40d1-bea7-3c0b7d410f69 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:11:15.518779 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1991861763", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e995c6e-c3ce-4e05-9f56-a5572491371e"}], "security_groups": [{"name": "tempest-securitygroup--928312488"}], "key_name": "tempest-keypair-1019366119", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:15.621034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] validate_networks() for [('1e995c6e-c3ce-4e05-9f56-a5572491371e', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:11:15.997522 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:11:15.997760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:11:15.998238 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:11:15.998673 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:11:15.999085 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:11:16.008787 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:16.009236 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:16.010029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:16.010465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:16.026930 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for project eaf9f75abc034491bd1b8846c05bf625. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:11:16.030875 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Getting quotas for user 3720c2225b51464abee34d05a69b9db7 and project eaf9f75abc034491bd1b8846c05bf625. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:11:16.042182 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:11:16.044507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:11:16.093347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-21b8ff7b-efa0-4574-b35e-9fc0ab117057 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.578963 Jul 18 14:11:16.094431 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 168/353] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:11:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:11:16.104522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9f801e9e-44f9-4f0f-bdfc-cf2db742cc6f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:16.105128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9f801e9e-44f9-4f0f-bdfc-cf2db742cc6f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:16.171234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9f801e9e-44f9-4f0f-bdfc-cf2db742cc6f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:16.178297 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9f801e9e-44f9-4f0f-bdfc-cf2db742cc6f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1246 microversion: 2.1 time: 0.077915 Jul 18 14:11:16.178856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 186/354] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:16 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:17.195445 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:17.196260 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:17.203140 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:17.203589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:17.204414 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:17.204875 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:17.264663 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:17.272661 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2a4af50d-b50d-42df-8b12-9c235cd12bee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1250 microversion: 2.1 time: 0.081049 Jul 18 14:11:17.273219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 169/355] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:17 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:18.289932 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:18.290785 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:18.298197 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:18.298688 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:18.299442 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:18.299865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:18.360717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:18.369369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ef945b44-2d62-4495-a700-3e00a60c761a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1250 microversion: 2.1 time: 0.083211 Jul 18 14:11:18.369939 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 187/356] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:18 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:19.387071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:19.387782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:19.396288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:19.396731 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:19.397486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:19.397911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:19.462022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:19.471347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d7eb16cd-0a4e-40aa-affc-c5f0fa956b21 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1242 microversion: 2.1 time: 0.088364 Jul 18 14:11:19.471908 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 170/357] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:19 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:20.488800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:20.489404 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:20.495885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.496365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.497129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:20.497563 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:20.579783 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:20.587178 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7509e574-cfe0-47bb-a831-49c062fd7732 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1304 microversion: 2.1 time: 0.102804 Jul 18 14:11:20.587753 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 188/358] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:20 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:21.442993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-221c2c6f-a4f8-4f50-b1f1-44d53d7c76fe req-3b919d59-30e1-4195-b2dd-b6ed17c5e65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfcc3bf9-291d-4700-bd55-f2116a5be826", "tag": "b727dd55-3851-43a8-95d2-3c1008ebee22"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:21.462859 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-221c2c6f-a4f8-4f50-b1f1-44d53d7c76fe req-3b919d59-30e1-4195-b2dd-b6ed17c5e65e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:21.464257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-221c2c6f-a4f8-4f50-b1f1-44d53d7c76fe req-3b919d59-30e1-4195-b2dd-b6ed17c5e65e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:21.478428 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-221c2c6f-a4f8-4f50-b1f1-44d53d7c76fe req-3b919d59-30e1-4195-b2dd-b6ed17c5e65e service nova] Creating event network-changed:b727dd55-3851-43a8-95d2-3c1008ebee22 for instance cfcc3bf9-291d-4700-bd55-f2116a5be826 on hv-cinder-84984 Jul 18 14:11:21.486327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-221c2c6f-a4f8-4f50-b1f1-44d53d7c76fe req-3b919d59-30e1-4195-b2dd-b6ed17c5e65e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050166 Jul 18 14:11:21.487013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 171/359] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:21.604265 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:21.605481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:21.614326 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:21.614939 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:21.615706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:21.616180 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:21.776039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:21.792147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a19d4f6a-6501-474a-aa84-b76971d409e0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.188730 Jul 18 14:11:21.792147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 189/360] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:21 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:22.806962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:22.807781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:22.814183 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:22.814627 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:22.815928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:22.816377 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:22.947014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:22.954489 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f8e7c7b8-653a-40d8-8278-f6e505fb4d6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.151840 Jul 18 14:11:22.955038 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 172/361] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:22 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:23.970952 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:23.971573 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:23.978071 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:23.978593 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:23.979269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:23.979700 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:24.108406 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:24.116222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-33916a55-e88d-499b-86ea-fb13d5b45b8d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.149088 Jul 18 14:11:24.116763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 190/362] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:23 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:25.133655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:25.134266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:25.140399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:25.140849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:25.141606 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:25.142038 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:25.270800 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:25.278523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3546961c-e5e9-41d3-8bf8-490319ffd9fe tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.148653 Jul 18 14:11:25.279081 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 173/363] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:25 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:26.295997 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:26.296779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:26.300214 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:26.306474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:26.306919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:26.307690 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:26.308151 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:26.484362 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:26.492252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c1fb7b55-ef30-4f8f-8313-7363fea78d15 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.200633 Jul 18 14:11:26.492809 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 191/364] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:26 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:27.510527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:27.511164 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:27.513443 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:27.514092 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=10 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:27.520580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:27.521029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:27.521798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:27.522228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:27.658867 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:27.666229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0d87e53f-3dfa-42c8-a568-6bb4ce088568 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.160527 Jul 18 14:11:27.666793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 174/365] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:27 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:28.683129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:28.683735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:28.690699 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:28.691141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:28.691903 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:28.692429 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:28.822634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:28.830002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9a673614-68ab-4ae5-8eb3-948fa934964a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.150791 Jul 18 14:11:28.830566 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 192/366] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:28 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:29.847254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:29.847881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:29.855205 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:29.855664 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:29.856713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:29.857226 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:29.988982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:29.997959 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f6b894ba-4044-44d8-8365-a2584bfea332 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.154410 Jul 18 14:11:29.998894 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 175/367] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:29 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:31.014572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:31.015178 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:31.023020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:31.023471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:31.024283 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:31.024724 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:31.040112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=100 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:31.157450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:31.165370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9e371ff0-7d56-4787-9674-f6988e6c3fb1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.154657 Jul 18 14:11:31.165931 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 193/368] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:31 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:32.182760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:32.183362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:32.189511 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:32.189952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:32.190697 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:32.191838 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:32.318386 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:32.325636 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-89490e7c-7cb9-412e-ac92-4da02a2b84db tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.146815 Jul 18 14:11:32.326194 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 176/369] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:32 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:33.342631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:33.343195 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:33.350294 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:33.350740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:33.351495 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:33.351929 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:33.483361 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:33.490730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9dd1b2e0-905a-4094-b38a-874b1f32764a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.152049 Jul 18 14:11:33.491289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 194/370] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:33 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:34.507068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:34.507683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:34.513718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:34.514161 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:34.514911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:34.515377 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:34.643059 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:34.651200 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-06f5cf3a-671f-4fc8-b39a-8092196637de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.147898 Jul 18 14:11:34.651770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 177/371] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:34 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:35.668041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:35.668650 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:35.675254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:35.676201 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:35.676963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:35.677396 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:35.813170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:35.820436 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cc24a25a-b71d-4cdf-9d3a-4f32c1fcb102 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.156279 Jul 18 14:11:35.820994 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 195/372] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:35 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:36.837930 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:36.838941 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:36.844871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:36.845316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:36.846075 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:36.846533 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:36.981888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:36.989301 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-af815b07-aad6-4652-b5bb-9f31b887d54f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.155154 Jul 18 14:11:36.989865 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 178/373] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:36 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:38.009955 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:38.011409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:38.018042 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:38.018490 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:38.019300 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:38.019732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:38.158634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:38.166006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a825caef-0cb6-4b99-a4ef-1a3214a78791 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.163547 Jul 18 14:11:38.166567 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 196/374] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:38 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:39.182500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:39.183103 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:39.189695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:39.190144 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:39.191747 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:39.192108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:39.536777 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:39.539050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=84 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:39.545204 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-93191973-e68e-4d00-8b7b-c3b64b3b0b93 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.366575 Jul 18 14:11:39.545759 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 179/375] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:39 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:40.563248 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:40.564249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:40.569138 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:40.573419 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:40.574275 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:40.575257 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:40.575686 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:40.747601 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:40.756195 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fc470f2f-c1d8-43cb-b14e-dd951eee5654 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.197398 Jul 18 14:11:40.757166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 197/376] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:40 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:41.774499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:41.775327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:41.777853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:41.795744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:41.796358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:41.797283 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:41.801069 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:41.977018 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:41.984984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-65b2996e-3017-4868-81ca-5337793aedcc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.214638 Jul 18 14:11:41.985848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 180/377] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:41 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:43.003598 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:43.004271 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:43.010749 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:43.011134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:43.012456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:43.012456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:43.147239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:43.155002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2127bc54-2b31-4917-bbdd-fd61613872d4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.155605 Jul 18 14:11:43.155576 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 198/378] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:42 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:44.184364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:44.185118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:44.210499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:44.212041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:44.215218 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:44.217761 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:44.489459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:44.500708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-11e48491-4e25-470c-b535-3053614b717d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.327898 Jul 18 14:11:44.501836 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 181/379] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:44 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:45.526624 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:45.528411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:45.537289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:45.538496 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:45.539694 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:45.540372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:45.723587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:45.735535 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e566877e-a0ab-41d8-81d4-57a9c456c27c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.213124 Jul 18 14:11:45.736454 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 199/380] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:45 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:46.039588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:46.040914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:46.047533 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:46.048392 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:46.050218 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:46.051094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:46.229553 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lazy-loading 'services' on Instance uuid 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:11:46.394503 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fc469801-1ca0-4db0-b247-0cdfb7a1216b tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "DELETE /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc/os-volume_attachments/d442bb49-1a4c-42f8-ace4-0438b2ae4360" status: 202 len: 0 microversion: 2.1 time: 0.358172 Jul 18 14:11:46.396025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 182/381] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:11:46 2022] DELETE /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc/os-volume_attachments/d442bb49-1a4c-42f8-ace4-0438b2ae4360 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:11:46.758825 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:46.760001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:46.782366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:46.782980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:46.787854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:46.788457 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:46.983095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:46.993135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6754f9a6-2103-40a6-bec3-7a01ea6c525f tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.242093 Jul 18 14:11:46.994234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 200/382] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:46 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:47.209656 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-8d63c3dd-a38d-4d89-aa05-e61134e2d538 req-b4051e29-7869-41e7-9961-b36bb8d23044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcc3bf9-291d-4700-bd55-f2116a5be826", "name": "network-vif-plugged", "status": "completed", "tag": "b727dd55-3851-43a8-95d2-3c1008ebee22"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:47.236880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8d63c3dd-a38d-4d89-aa05-e61134e2d538 req-b4051e29-7869-41e7-9961-b36bb8d23044 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:47.238999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8d63c3dd-a38d-4d89-aa05-e61134e2d538 req-b4051e29-7869-41e7-9961-b36bb8d23044 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:47.266338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-8d63c3dd-a38d-4d89-aa05-e61134e2d538 req-b4051e29-7869-41e7-9961-b36bb8d23044 service nova] Creating event network-vif-plugged:b727dd55-3851-43a8-95d2-3c1008ebee22 for instance cfcc3bf9-291d-4700-bd55-f2116a5be826 on hv-cinder-84984 Jul 18 14:11:47.281056 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-8d63c3dd-a38d-4d89-aa05-e61134e2d538 req-b4051e29-7869-41e7-9961-b36bb8d23044 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079435 Jul 18 14:11:47.284505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 183/383] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:48.019022 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:48.019854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:48.033251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:48.033947 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:48.034976 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:48.036198 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:48.231450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:48.240040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-acf1e6d9-fbdf-45f9-8396-4510f17c2ab0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.225973 Jul 18 14:11:48.241874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 201/384] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:48 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:48.630115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:48.631043 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:48.639246 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:48.639693 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:48.640535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:48.646395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:48.690510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:11:48.898477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-50cf022f-6869-4ed3-b936-26a6ed234a87 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "DELETE /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 204 len: 0 microversion: 2.1 time: 0.272457 Jul 18 14:11:48.898890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 184/385] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:11:48 2022] DELETE /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:11:48.907289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:48.908196 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:48.914943 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:48.915373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:48.916229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:48.916654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:49.083012 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:49.093740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-065cbff1-1788-4677-b9f0-756a9bdb0fa6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1561 microversion: 2.1 time: 0.190265 Jul 18 14:11:49.095305 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 202/386] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:48 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:11:49.259455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:49.261361 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:49.270115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:49.270886 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:49.271998 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:49.273092 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:49.480781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:49.498183 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f7af9095-49c8-4597-8d74-e287af8f3563 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.243763 Jul 18 14:11:49.498688 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 185/387] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:49 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:50.114090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:50.114898 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:50.121916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:50.122435 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:50.123567 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:50.124111 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:50.308003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:50.318378 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-14429b4e-149f-4a06-92ff-50b81f6f6ab6 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1515 microversion: 2.1 time: 0.208747 Jul 18 14:11:50.319174 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 203/388] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:50 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:50.514675 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:50.515287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:50.523145 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:50.523816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:50.524804 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:50.525409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:50.677319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:50.686295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c34e2638-67cb-4778-bbc2-df9e56f58557 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.175079 Jul 18 14:11:50.692295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 186/389] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:50 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:51.340825 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:51.341575 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:51.349459 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:51.349900 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:51.350852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:51.351277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:51.520950 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:51.529485 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-38d881ce-4fb4-4a76-96b2-42732c691784 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1515 microversion: 2.1 time: 0.193761 Jul 18 14:11:51.530586 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 204/390] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:51 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:51.714641 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:51.715278 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:51.721998 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:51.722733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:51.723688 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:51.724302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:51.889435 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:51.898699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8aeea4d5-12c7-4854-8397-8eac6877c341 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1371 microversion: 2.1 time: 0.192152 Jul 18 14:11:51.908022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 187/391] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:51 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:52.547245 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:52.548577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:52.562169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:52.563839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:52.567463 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:52.569775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:52.796482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:52.807987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9fa94a83-1a26-46d9-afb1-5ab6df794726 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1515 microversion: 2.1 time: 0.264333 Jul 18 14:11:52.809128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 205/392] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:52 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1515 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:52.925111 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:52.926313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:52.941608 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:52.942327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:52.943715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:52.944334 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:53.148940 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:53.158297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-523a4cfb-d4cb-4a98-b243-d5604854c3bb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1564 microversion: 2.1 time: 0.237074 Jul 18 14:11:53.158891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 188/393] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:52 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:53.180824 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-42164298-6e97-4826-aa35-5df29986b073 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:53.181745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-42164298-6e97-4826-aa35-5df29986b073 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:53.191780 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42164298-6e97-4826-aa35-5df29986b073 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:53.192636 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42164298-6e97-4826-aa35-5df29986b073 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:53.193800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42164298-6e97-4826-aa35-5df29986b073 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:53.194753 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42164298-6e97-4826-aa35-5df29986b073 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:53.387691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-42164298-6e97-4826-aa35-5df29986b073 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.212029 Jul 18 14:11:53.397130 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 206/394] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:11:53 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:53.829372 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:53.829970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:53.847430 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-fca6626f-c072-4434-b687-7ef6ff3631f3 req-bfe1d460-1300-47d5-908c-f34ae288b663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a3c06e-1c78-4d8a-ad1f-b370fc8655bc", "name": "network-vif-deleted", "tag": "c018dd1c-f83e-4569-ac2c-144655327803"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:53.848040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:53.848828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:53.849603 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:53.851134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:53.863710 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-fca6626f-c072-4434-b687-7ef6ff3631f3 req-bfe1d460-1300-47d5-908c-f34ae288b663 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:53.864440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-fca6626f-c072-4434-b687-7ef6ff3631f3 req-bfe1d460-1300-47d5-908c-f34ae288b663 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:53.881706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-fca6626f-c072-4434-b687-7ef6ff3631f3 req-bfe1d460-1300-47d5-908c-f34ae288b663 service nova] Creating event network-vif-deleted:c018dd1c-f83e-4569-ac2c-144655327803 for instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc on hv-cinder-84984 Jul 18 14:11:53.888487 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-fca6626f-c072-4434-b687-7ef6ff3631f3 req-bfe1d460-1300-47d5-908c-f34ae288b663 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048752 Jul 18 14:11:53.893712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 207/395] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:11:54.038547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:54.054331 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-458dbbd7-4a68-4f0f-a2c3-39485061aae0 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 200 len: 1473 microversion: 2.1 time: 0.228614 Jul 18 14:11:54.055189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 189/396] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:53 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:54.954031 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-b1304024-86bb-44e0-a5c6-8bcbe5a45828 req-a7ff6bf2-5f7d-4d2f-9fb9-8000085cf529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfcc3bf9-291d-4700-bd55-f2116a5be826", "tag": "b727dd55-3851-43a8-95d2-3c1008ebee22"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:54.974680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b1304024-86bb-44e0-a5c6-8bcbe5a45828 req-a7ff6bf2-5f7d-4d2f-9fb9-8000085cf529 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:54.975331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b1304024-86bb-44e0-a5c6-8bcbe5a45828 req-a7ff6bf2-5f7d-4d2f-9fb9-8000085cf529 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:55.013025 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-b1304024-86bb-44e0-a5c6-8bcbe5a45828 req-a7ff6bf2-5f7d-4d2f-9fb9-8000085cf529 service nova] Creating event network-changed:b727dd55-3851-43a8-95d2-3c1008ebee22 for instance cfcc3bf9-291d-4700-bd55-f2116a5be826 on hv-cinder-84984 Jul 18 14:11:55.026916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-b1304024-86bb-44e0-a5c6-8bcbe5a45828 req-a7ff6bf2-5f7d-4d2f-9fb9-8000085cf529 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095838 Jul 18 14:11:55.032204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 208/397] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:55.071761 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:55.072592 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:55.081083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:55.082960 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:55.083905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:55.084369 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:55.102248 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] HTTP exception thrown: Instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc could not be found. Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Request method failure captured: Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc HTTP/1.1 Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WmkZ_JvQH5UE042BAFhaC-ChkUU3FRfTPLoUhPaxikLjkK0yEbCydHuqXVoXsV2VgFDCp1jmig5o99DkfctNIx3XgPROqB03yOC-GHFqfJNG_WLWRMH7nrZkjTYqgZzL4X-7gVB-7RNhxdtTDEuOCvlPZ9uKWOx4wUPMr6Ph38jynY Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9f6e581c160d4e64a81e0b35907cc078 Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-VolumesSnapshotTestJSON-405527568 Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:11:55.104815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9f6e581c160d4e64a81e0b35907cc078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9f6e581c160d4e64a81e0b35907cc078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9f6e581c160d4e64a81e0b35907cc078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9f6e581c160d4e64a81e0b35907cc078"}]}] Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-VolumesSnapshotTestJSON-405527568 Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9f6e581c160d4e64a81e0b35907cc078 Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-405527568 Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-VolumesSnapshotTestJSON-405527568-project Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: da8ecff90e714e4e961f8a8104143f62 Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-VolumesSnapshotTestJSON-405527568-project Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc could not be found. Jul 18 14:11:55.106229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '80a3c06e-1c78-4d8a-ad1f-b370fc8655bc'} Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc could not be found. Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:11:55.107015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc could not be found. Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc could not be found. Jul 18 14:11:55.108333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:11:55.110910 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Returning 404 to user: Instance 80a3c06e-1c78-4d8a-ad1f-b370fc8655bc could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:11:55.112556 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c314e6c8-7a4a-4236-8e8b-3cfb5a0eb8d8 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc" status: 404 len: 111 microversion: 2.1 time: 0.044609 Jul 18 14:11:55.116785 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 190/398] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:55 2022] GET /compute/v2.1/servers/80a3c06e-1c78-4d8a-ad1f-b370fc8655bc => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:11:55.321202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-659307537", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1494975757", "security_groups": [{"name": "tempest-secgroup-smoke-1475898836"}], "networks": [{"uuid": "3ec35dc1-02fe-4ebc-8138-0a035afc8c58"}], "block_device_mapping_v2": [{"uuid": "b06d203c-1dcd-40f6-a039-26ebbe0071f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:55.553923 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] validate_networks() for [('3ec35dc1-02fe-4ebc-8138-0a035afc8c58', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:11:56.316902 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:11:56.317493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:11:56.317821 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:11:56.318223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:11:56.318818 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:11:56.329341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:56.329779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:56.331450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:56.331881 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:56.350249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Getting quotas for project f618e7dff5d7411eb4d4cade50d68607. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:11:56.354482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Getting quotas for user 2aa4925080114a33b80e2ca588fbeb27 and project f618e7dff5d7411eb4d4cade50d68607. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:11:56.475522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:11:56.477735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b06d203c-1dcd-40f6-a039-26ebbe0071f9',volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:11:56.653437 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [55e6da74-303f-453a-b8da-d5e8298d7b7a] AMQP server on 10.222.0.94:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:11:57.661633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [55e6da74-303f-453a-b8da-d5e8298d7b7a] Reconnected to AMQP server on 10.222.0.94:5672 via [amqp] client with port 56060. Jul 18 14:11:57.665932 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a748e9ee-601c-42f6-8751-5ab7037f6cd9 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.366034 Jul 18 14:11:57.666568 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 209/399] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:11:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:11:57.676380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5cdb036e-9f3a-4c52-812f-524ce6501895 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:57.676978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5cdb036e-9f3a-4c52-812f-524ce6501895 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:57.730774 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5cdb036e-9f3a-4c52-812f-524ce6501895 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:57.738479 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5cdb036e-9f3a-4c52-812f-524ce6501895 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1088 microversion: 2.1 time: 0.065927 Jul 18 14:11:57.744652 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 191/400] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:57 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:58.755072 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:58.755687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:58.762092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:58.762533 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:58.763280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:58.763708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:58.823225 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:58.831083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-01653b54-6dbf-41bf-befc-6e8b31512ca7 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1138 microversion: 2.1 time: 0.080387 Jul 18 14:11:58.831639 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 210/401] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:58 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1138 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:59.848399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:59.849281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:11:59.855919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:59.856505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:59.857527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:11:59.858026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:11:59.922520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:11:59.932150 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-55b88a99-3018-45a8-beff-3856b457a1cd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1186 microversion: 2.1 time: 0.087666 Jul 18 14:11:59.933821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 192/402] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:11:59 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:00.957292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:00.957988 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:00.964633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:00.965615 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:00.966604 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:00.967282 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:01.046522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:01.056679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=96 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:01.060793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c2f8f706-adc5-47b6-8c47-59652d81beff tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1204 microversion: 2.1 time: 0.109504 Jul 18 14:12:01.061930 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 211/403] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:00 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1204 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:02.080871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:02.081440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:02.087812 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:02.088970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:02.089752 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:02.090191 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:02.392982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:02.403261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-23a67ec2-7a4d-4960-a997-0b13bcd77f39 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1272 microversion: 2.1 time: 0.326440 Jul 18 14:12:02.406320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 193/404] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:02 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:02.680515 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-da1b0b14-8196-40f7-91e9-cf4e10635026 req-950b183d-d114-4d35-989a-20246a8c6ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63c8795-24b6-46d9-95ae-0496378efce1", "tag": "a158e474-2cc0-48e6-9c01-f790a2f7a2a3"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:02.692004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-da1b0b14-8196-40f7-91e9-cf4e10635026 req-950b183d-d114-4d35-989a-20246a8c6ac8 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:02.692637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-da1b0b14-8196-40f7-91e9-cf4e10635026 req-950b183d-d114-4d35-989a-20246a8c6ac8 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:02.704168 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-da1b0b14-8196-40f7-91e9-cf4e10635026 req-950b183d-d114-4d35-989a-20246a8c6ac8 service nova] Creating event network-changed:a158e474-2cc0-48e6-9c01-f790a2f7a2a3 for instance c63c8795-24b6-46d9-95ae-0496378efce1 on hv-cinder-84984 Jul 18 14:12:02.716318 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-da1b0b14-8196-40f7-91e9-cf4e10635026 req-950b183d-d114-4d35-989a-20246a8c6ac8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039224 Jul 18 14:12:02.717219 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 212/405] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:03.422030 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:03.422568 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:03.428637 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:03.429083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:03.429835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:03.430270 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:03.562570 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:03.569884 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f48c3ede-1fe8-43da-936b-46f0eec302db tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.151779 Jul 18 14:12:03.570444 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 194/406] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:03 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:04.587730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:04.588379 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:04.594525 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:04.594968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:04.595724 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:04.596252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:04.733013 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:04.740940 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d98f7492-3b7b-4509-9e61-adb4c79855d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.157989 Jul 18 14:12:04.741491 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 213/407] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:04 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:05.757374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:05.757915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:05.764115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:05.764579 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:05.765327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:05.765762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:05.894098 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:05.901448 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-60e893a9-6828-482e-a8db-a2d6c242dd68 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.148031 Jul 18 14:12:05.902004 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 195/408] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:05 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:06.918496 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:06.919177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:06.921676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:06.922489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:06.929291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:06.929737 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:06.930990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:06.931483 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:07.072555 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:07.080067 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-62a688b3-60f9-4874-943c-42697fad813a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.165368 Jul 18 14:12:07.080631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 214/409] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:06 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:08.097324 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:08.097949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:08.100037 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:08.106290 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:08.106822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:08.107619 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:08.108151 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:08.125520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:08.252989 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:08.260549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f91180e0-d1d7-48aa-98b2-bd8f0f0e629a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.167869 Jul 18 14:12:08.261198 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 196/410] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:08 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:12:09.277482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:09.277993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:09.285117 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:09.285565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:09.286328 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:09.286761 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:09.414775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:09.422081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c3c48d2a-e93d-42c4-8940-19b84f7880c5 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.148508 Jul 18 14:12:09.422648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 215/411] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:09 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:10.438870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:10.439468 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:10.445402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:10.445840 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:10.446581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:10.447003 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:10.576095 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:10.584557 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9dedf813-4f0e-4fce-b83f-e1bdc868afde tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.149821 Jul 18 14:12:10.585120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 197/412] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:10 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:11.601493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:11.602025 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:11.604412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:11.610598 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:11.611035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:11.611792 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:11.612239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:11.745733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:11.753035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1dc037f3-2c59-4483-9dec-e89584b70aa6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.155513 Jul 18 14:12:11.753584 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 216/413] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:11 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:12.769962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:12.770555 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:12.772426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:12.777521 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:12.777958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:12.778707 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:12.779131 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:12.907226 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:12.914451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d2765e3f-1cb3-4673-93b3-8e7044faf992 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.148875 Jul 18 14:12:12.915003 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 198/414] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:12 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:13.931376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:13.932004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:13.939472 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:13.939921 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:13.940779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:13.941212 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:14.071624 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:14.079534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7cd69ed5-b1b0-4744-88a3-747eb7f6d394 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.151414 Jul 18 14:12:14.080126 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 217/415] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:13 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:15.096182 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:15.097408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:15.103342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:15.103781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:15.104573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:15.105001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:15.232272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:15.239607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b9371617-5ba7-41af-b4cb-4626119e203f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.147341 Jul 18 14:12:15.240188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 199/416] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:15 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:16.256139 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:16.256685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:16.262988 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:16.263433 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:16.264202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:16.264630 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:16.394480 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:16.401798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-add96ae5-efb5-4688-93fe-79e6c1f98344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.149549 Jul 18 14:12:16.402358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 218/417] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:16 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:17.418846 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:17.419453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:17.425434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:17.425877 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:17.426633 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:17.427066 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:17.558745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:17.566371 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1c9cd4e4-a0f8-477e-96b4-2066a61811be tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.151402 Jul 18 14:12:17.566927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 200/418] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:17 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:18.582300 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:18.582896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:18.589403 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:18.589837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:18.590586 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:18.591007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:18.721887 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:18.729870 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bad06be3-2d2c-481d-829f-aa6b347d5f9d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.151304 Jul 18 14:12:18.736563 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 219/419] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:18 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:19.746489 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:19.747094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:19.753213 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:19.753665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:19.754423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:19.754857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:19.863587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2080327024", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "networks": [{"uuid": "4bde0255-5a3f-47b3-9352-0e55a47d42ba"}]}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:19.888655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:19.896602 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1c58c396-c672-4ca6-8993-38aedd167c22 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.153968 Jul 18 14:12:19.897179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 201/420] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:19 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:19.917537 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] validate_networks() for [('4bde0255-5a3f-47b3-9352-0e55a47d42ba', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:12:20.259322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:12:20.259676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:12:20.260174 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:12:20.260576 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:12:20.260978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:12:20.270215 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:20.270657 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:20.271438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:20.271894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:20.287986 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Getting quotas for project 9f6e581c160d4e64a81e0b35907cc078. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:12:20.291843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Getting quotas for user da8ecff90e714e4e961f8a8104143f62 and project 9f6e581c160d4e64a81e0b35907cc078. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:12:20.303033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:12:20.305256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:12:20.352015 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a4194e1d-149a-4e45-b183-009e781c290f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492264 Jul 18 14:12:20.352650 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 220/421] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:12:20.363077 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a539f772-78ab-4102-a0a9-0e0f42c4ecc9 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:20.363751 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a539f772-78ab-4102-a0a9-0e0f42c4ecc9 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:20.416945 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a539f772-78ab-4102-a0a9-0e0f42c4ecc9 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:20.424181 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a539f772-78ab-4102-a0a9-0e0f42c4ecc9 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1219 microversion: 2.1 time: 0.065428 Jul 18 14:12:20.424778 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 202/422] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:20 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:20.914349 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:20.914986 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:20.921213 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:20.921662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:20.922421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:20.922858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:21.055352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:21.064325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-12125ff1-2def-42d2-9005-6468a7bb4e45 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.153517 Jul 18 14:12:21.065330 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 221/423] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:20 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:21.441126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:21.441723 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:21.447682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:21.448155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:21.448899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:21.449322 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:21.511574 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:21.518810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-737bf229-b42f-4028-bad1-61fd6b325d1f tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1223 microversion: 2.1 time: 0.081485 Jul 18 14:12:21.519358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 203/424] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:21 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:22.080868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:22.081484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:22.087970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:22.088421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:22.089186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:22.089627 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:22.218521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:22.226401 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2a1ae222-7623-466f-92d5-5d7f229d740a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.149356 Jul 18 14:12:22.227082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 222/425] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:22 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:22.536028 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:22.536568 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:22.542552 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:22.543005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:22.543744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:22.544200 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:22.603017 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:22.610733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3224d444-0313-4755-ac13-374eb3d93c16 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1223 microversion: 2.1 time: 0.079124 Jul 18 14:12:22.611380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 204/426] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:22 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:23.243367 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:23.243906 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:23.250050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:23.250489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:23.251246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:23.251676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:23.383816 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:23.392330 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5dc6d866-e6cf-4c56-84c9-0c7eb3625266 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.152838 Jul 18 14:12:23.392883 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 223/427] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:23 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:23.628973 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:23.629582 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:23.635760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:23.636241 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:23.637005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:23.637439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:23.697741 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:23.705049 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-77fda957-504a-44b3-a6ee-7bfac59ee054 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1223 microversion: 2.1 time: 0.081254 Jul 18 14:12:23.705614 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 205/428] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:23 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:24.409148 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:24.409749 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:24.416237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:24.416676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:24.417428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:24.417856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:24.545500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:24.553346 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-01cddf02-8981-4bc9-baf5-91461b5b4c0f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.148541 Jul 18 14:12:24.553920 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 224/429] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:24 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:24.722349 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:24.722962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:24.729310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:24.729983 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:24.731071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:24.731781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:24.797305 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:24.805253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dc44db4f-1d3a-4bbf-b3c8-e7eef4b90e89 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1223 microversion: 2.1 time: 0.087354 Jul 18 14:12:24.805728 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 206/430] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:24 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:25.570306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:25.571387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:25.578369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:25.579431 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:25.580310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:25.580837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:25.728167 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:25.737268 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6a261bed-5f93-46c6-bb8f-2b9cb167305d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.170727 Jul 18 14:12:25.738109 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 225/431] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:25 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:25.833822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:25.836055 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:25.843621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:25.844482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:25.845627 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:25.846246 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:25.931272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:25.941342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c345517d-6b62-4a6d-b6f3-6152236e072c tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1289 microversion: 2.1 time: 0.121865 Jul 18 14:12:25.951380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 207/432] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:25 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:26.759046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:26.760053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:26.767407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:26.768024 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:26.769035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:26.769557 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:26.959995 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:26.961390 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:26.968523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:26.970092 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:26.971320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:26.972091 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:26.995060 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:27.006013 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9baccfd4-b005-4b4a-98ea-5724d02ad9c4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.254848 Jul 18 14:12:27.011282 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 226/433] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:26 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:27.432477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:27.441281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7317e79f-df36-4ad1-ad95-b1c37414fcbb tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.485648 Jul 18 14:12:27.452498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 208/434] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:26 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:12:27.585556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-982b5451-02fb-47f9-bb9a-9e2d349449a0 req-7816e702-8329-4477-b5c2-0726bac89cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e89663-a166-4505-83e7-f80979408077", "tag": "5d278c35-21f0-4071-9f02-a94ec22d3ce8"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:27.595014 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-982b5451-02fb-47f9-bb9a-9e2d349449a0 req-7816e702-8329-4477-b5c2-0726bac89cc5 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:27.595769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-982b5451-02fb-47f9-bb9a-9e2d349449a0 req-7816e702-8329-4477-b5c2-0726bac89cc5 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:27.612480 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-982b5451-02fb-47f9-bb9a-9e2d349449a0 req-7816e702-8329-4477-b5c2-0726bac89cc5 service nova] Creating event network-changed:5d278c35-21f0-4071-9f02-a94ec22d3ce8 for instance 84e89663-a166-4505-83e7-f80979408077 on hv-cinder-84984 Jul 18 14:12:27.617886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-982b5451-02fb-47f9-bb9a-9e2d349449a0 req-7816e702-8329-4477-b5c2-0726bac89cc5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035758 Jul 18 14:12:27.618404 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 227/435] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:28.026619 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:28.026619 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:28.033342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:28.033789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:28.034675 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:28.035107 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:28.180993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:28.188853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e3f419d1-24ef-4caf-9fb1-446b00867272 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.166794 Jul 18 14:12:28.189415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 209/436] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:28 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:28.461111 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:28.461749 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:28.468052 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:28.468500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:28.469311 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:28.469742 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:28.600253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:28.608194 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-aa4a54a7-e83d-4722-97a7-bcfaa89aa43a tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.151595 Jul 18 14:12:28.609087 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 228/437] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:28 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:29.029210 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c8954f3c-40df-40d7-8edd-20228acf4672 req-2ac9d7a9-0291-4713-88d5-70efe13ea94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c8795-24b6-46d9-95ae-0496378efce1", "name": "network-vif-plugged", "status": "completed", "tag": "a158e474-2cc0-48e6-9c01-f790a2f7a2a3"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:29.039612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c8954f3c-40df-40d7-8edd-20228acf4672 req-2ac9d7a9-0291-4713-88d5-70efe13ea94c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:29.040146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c8954f3c-40df-40d7-8edd-20228acf4672 req-2ac9d7a9-0291-4713-88d5-70efe13ea94c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:29.051322 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c8954f3c-40df-40d7-8edd-20228acf4672 req-2ac9d7a9-0291-4713-88d5-70efe13ea94c service nova] Creating event network-vif-plugged:a158e474-2cc0-48e6-9c01-f790a2f7a2a3 for instance c63c8795-24b6-46d9-95ae-0496378efce1 on hv-cinder-84984 Jul 18 14:12:29.056224 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c8954f3c-40df-40d7-8edd-20228acf4672 req-2ac9d7a9-0291-4713-88d5-70efe13ea94c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030897 Jul 18 14:12:29.056993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 210/438] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:29.206098 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:29.206718 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:29.212937 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:29.213388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:29.214163 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:29.214595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:29.347992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:29.355420 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cd2c98b0-ea8a-4f83-926e-2326df23764a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.153727 Jul 18 14:12:29.355984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 229/439] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:29 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:29.638690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:29.638690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:29.638690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:29.638690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:29.639050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:29.639050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:29.773668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:29.781870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ce3f5313-8825-4b47-aa48-b351fb7f22de tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.158842 Jul 18 14:12:29.782429 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 211/440] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:29 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:30.371730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:30.372375 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:30.375226 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:30.375875 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:30.382551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:30.382987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:30.383746 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:30.384198 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:30.399676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=100 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:30.538118 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:30.546348 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-01549a2c-114d-4494-9347-64b80be4f03b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.178620 Jul 18 14:12:30.555686 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 230/441] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:30 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:30.798946 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:30.799580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:30.803311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:30.807539 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:30.808042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:30.809370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:30.809807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:30.956906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:30.967389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-16818a6d-b42f-4a8f-9731-615ebd8d7866 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.171447 Jul 18 14:12:30.976630 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 212/442] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:30 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:31.562747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:31.563454 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:31.569948 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:31.570389 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:31.571146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:31.571572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:31.744495 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:31.752508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4f18603b-88ff-41ce-be60-3483778a1bda tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.193769 Jul 18 14:12:31.764325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 231/443] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:31 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:31.985302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:31.986125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:31.993303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:31.993904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:31.994827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:31.995371 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:32.251650 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:32.258907 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fac52efa-81de-46de-a426-8182b4531833 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.277995 Jul 18 14:12:32.259467 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 213/444] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:31 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:32.768966 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:32.769580 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:32.776182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:32.776628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:32.777399 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:32.777831 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:32.915534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:32.923180 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-aaa9ea87-1d9d-47f9-99fa-47fd6f91870b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.158728 Jul 18 14:12:32.923738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 232/445] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:32 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:33.275522 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:33.276154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:33.282099 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:33.282542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:33.283295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:33.283727 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:33.412796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:33.414978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=100 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:33.421961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-37cc01cd-1d5d-42d8-bf1d-cd89848bd6cc tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.149704 Jul 18 14:12:33.422512 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 214/446] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:33 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:33.594330 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-1688d413-fb94-4c5a-bea3-35bf19df253c req-c211c04c-9d19-434a-bbfa-392223576d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e89663-a166-4505-83e7-f80979408077", "name": "network-vif-plugged", "status": "completed", "tag": "5d278c35-21f0-4071-9f02-a94ec22d3ce8"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:33.602744 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-1688d413-fb94-4c5a-bea3-35bf19df253c req-c211c04c-9d19-434a-bbfa-392223576d5f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:33.603227 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-1688d413-fb94-4c5a-bea3-35bf19df253c req-c211c04c-9d19-434a-bbfa-392223576d5f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:33.615158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-1688d413-fb94-4c5a-bea3-35bf19df253c req-c211c04c-9d19-434a-bbfa-392223576d5f service nova] Creating event network-vif-plugged:5d278c35-21f0-4071-9f02-a94ec22d3ce8 for instance 84e89663-a166-4505-83e7-f80979408077 on hv-cinder-84984 Jul 18 14:12:33.622016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-1688d413-fb94-4c5a-bea3-35bf19df253c req-c211c04c-9d19-434a-bbfa-392223576d5f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 Jul 18 14:12:33.622693 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 233/447] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:33.939894 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:33.940778 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:33.951478 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:33.951581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:33.952483 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:33.952949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:34.108022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:34.118521 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9672fe84-0061-4a74-9483-b5f182f9c289 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.182335 Jul 18 14:12:34.119167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 215/448] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:33 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:34.440377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:34.441068 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:34.447248 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:34.447686 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:34.448474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:34.448899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:34.579660 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:34.587085 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d1c7f22e-5976-4fdc-8166-7f0e8e531dd3 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.151969 Jul 18 14:12:34.587643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 234/449] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:34 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:35.136197 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:35.136816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:35.142869 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:35.143321 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:35.144122 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:35.144557 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:35.275681 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:35.283970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7858a526-0fae-45f5-972d-8d8a2aec93ef tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.151579 Jul 18 14:12:35.284547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 216/450] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:35 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:35.604833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:35.605440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:35.612573 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:35.613017 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:35.613783 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:35.614214 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:35.743679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:35.751137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-efef4a8e-d02f-4814-b5f0-713ced190288 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.150210 Jul 18 14:12:35.751699 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 235/451] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:35 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:36.300860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:36.301416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:36.307443 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:36.307882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:36.308969 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:36.309469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:36.448872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:36.456243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ababaae2-638f-4dd7-a079-8144e7a4bedd tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.159285 Jul 18 14:12:36.456796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 217/452] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:36 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:36.767925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:36.768552 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:36.775076 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:36.775525 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:36.776313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:36.776745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:36.912407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:36.922037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f754d68c-7522-4d12-8fe9-9815b087a880 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.157973 Jul 18 14:12:36.923147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 236/453] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:36 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:37.473796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:37.474434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:37.480499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:37.480943 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:37.481694 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:37.482126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:37.611488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:37.618893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1260f0c9-8df1-43d9-bdf5-b0ab3f7f9bf0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.149593 Jul 18 14:12:37.619460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 218/454] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:37 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:37.939994 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:37.940609 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:37.947104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:37.947548 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:37.948352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:37.948785 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:38.075621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:38.083035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ae2404e2-a1a6-40f0-8c90-87cfd1c9a403 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.147429 Jul 18 14:12:38.083618 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 237/455] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:37 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:38.635223 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:38.635816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:38.642337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:38.642773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:38.643518 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:38.643960 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:38.777005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:38.784440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fd699c49-a22a-4fc3-8d82-ed1529a3d344 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.153060 Jul 18 14:12:38.785006 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 219/456] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:38 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:39.099652 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:39.100289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:39.106721 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:39.107156 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:39.107921 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:39.108389 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:39.243336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:39.253532 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-135f6329-154c-4676-acbb-1888e2276b44 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.157597 Jul 18 14:12:39.254113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 238/457] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:39 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:39.801853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:39.802495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:39.808463 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:39.809174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:39.809933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:39.810368 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:39.939027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:39.946488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2876af86-01b6-4402-85be-0a5dd410c54e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.148498 Jul 18 14:12:39.947047 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 220/458] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:39 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:40.271866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:40.272514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:40.279333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:40.279804 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:40.280587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:40.281019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:40.413745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:40.422155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8e1297d5-b66e-455f-8084-a56c740b4909 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.154806 Jul 18 14:12:40.422739 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 239/459] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:40 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:40.962625 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:40.963151 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:40.969249 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:40.969685 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:40.970591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:40.971019 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:41.099883 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:41.107433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-41cbce8a-46c8-4a80-bd54-6e4ca40fa235 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.148709 Jul 18 14:12:41.107996 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 221/460] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:40 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:41.438961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:41.439654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:41.446127 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:41.446572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:41.447333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:41.447767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:41.576011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:41.583654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f3e77557-0bb9-425d-8ae0-86ed24634e42 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.148722 Jul 18 14:12:41.584254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 240/461] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:41 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:42.124037 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:42.124646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:42.130723 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:42.131172 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:42.131974 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:42.132479 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:42.264294 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:42.271721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-89aa3ac1-6942-461e-aa80-7af2c3df4423 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.151486 Jul 18 14:12:42.272303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 222/462] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:42 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:42.601006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:42.601523 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:42.603895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:42.609197 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:42.609649 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:42.610416 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:42.610847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:42.753029 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:42.760518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e54c54e7-0311-4610-a3ae-c00e9563a240 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.163525 Jul 18 14:12:42.761081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 241/463] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:42 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:43.287998 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:43.288605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:43.290438 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=52 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:43.295815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:43.296286 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:43.297541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:43.297972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:43.438026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:43.445342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-302cc680-5b10-4fb6-b16d-462d5c962810 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1260 microversion: 2.1 time: 0.161152 Jul 18 14:12:43.445888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 223/464] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:43 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:43.778400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:43.779581 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:43.786253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:43.786691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:43.787632 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:43.788081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:43.918260 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:43.925527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8b7d0d6d-1ba8-4cc2-aaeb-2042d77ccaf5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.151326 Jul 18 14:12:43.926076 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 242/465] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:43 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:44.461859 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:44.462529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:44.468891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:44.469329 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:44.470157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:44.470631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:44.609268 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:44.617303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-47337d5d-e24f-4733-a525-0c01561829e4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1445 microversion: 2.1 time: 0.159677 Jul 18 14:12:44.617856 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 224/466] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:44 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:44.634129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:44.634735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:44.640648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:44.641088 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:44.641874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:44.642303 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:44.771698 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:44.779290 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a61d0d60-f60c-4c91-bb7c-7fb6d0c324ed tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1445 microversion: 2.1 time: 0.148878 Jul 18 14:12:44.784766 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 243/467] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:44 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:44.943910 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:44.944654 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:44.951132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:44.951582 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:44.952393 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:44.952858 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:45.158448 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:45.166181 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9a2c3000-abf7-4e05-a46f-68a7255fd486 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1319 microversion: 2.1 time: 0.227345 Jul 18 14:12:45.167001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 225/468] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:44 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:46.186267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:46.187441 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:46.194522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:46.194963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:46.195727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:46.196183 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:46.495034 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:12:46.502970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b5913d65-c259-498b-a279-32b92b37a1b5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1509 microversion: 2.1 time: 0.321290 Jul 18 14:12:46.503537 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 244/469] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:12:46 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1509 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:46.519904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-adea9f3b-d924-4dbc-b10c-fdda99acf11e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "040fca24-bcaf-4362-9495-57619d7ee33f", "device": "/dev/sdb"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:46.521525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-adea9f3b-d924-4dbc-b10c-fdda99acf11e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:12:46.527463 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adea9f3b-d924-4dbc-b10c-fdda99acf11e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:46.527911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adea9f3b-d924-4dbc-b10c-fdda99acf11e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:46.528714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adea9f3b-d924-4dbc-b10c-fdda99acf11e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:46.529153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adea9f3b-d924-4dbc-b10c-fdda99acf11e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:46.801966 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-adea9f3b-d924-4dbc-b10c-fdda99acf11e tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "POST /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286307 Jul 18 14:12:46.802644 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 226/470] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:12:46 2022] POST /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:47.659518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-56dfa845-7420-4a82-92a4-cfa63b036274 req-d7644f29-dd98-4d46-b2df-86f6f1616837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63c8795-24b6-46d9-95ae-0496378efce1", "tag": "a158e474-2cc0-48e6-9c01-f790a2f7a2a3"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:47.671757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-56dfa845-7420-4a82-92a4-cfa63b036274 req-d7644f29-dd98-4d46-b2df-86f6f1616837 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:12:47.672482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-56dfa845-7420-4a82-92a4-cfa63b036274 req-d7644f29-dd98-4d46-b2df-86f6f1616837 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:12:47.700792 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-56dfa845-7420-4a82-92a4-cfa63b036274 req-d7644f29-dd98-4d46-b2df-86f6f1616837 service nova] Creating event network-changed:a158e474-2cc0-48e6-9c01-f790a2f7a2a3 for instance c63c8795-24b6-46d9-95ae-0496378efce1 on hv-cinder-84984 Jul 18 14:12:47.707625 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-56dfa845-7420-4a82-92a4-cfa63b036274 req-d7644f29-dd98-4d46-b2df-86f6f1616837 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053983 Jul 18 14:12:47.708847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 245/471] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:00.599597 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=7 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:00.600467 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:00.605369 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-75bf2d1a-b1c8-4d43-9730-6827066cfff2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:00.606607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-75bf2d1a-b1c8-4d43-9730-6827066cfff2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:00.615338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf2d1a-b1c8-4d43-9730-6827066cfff2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:00.615784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf2d1a-b1c8-4d43-9730-6827066cfff2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:00.616581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf2d1a-b1c8-4d43-9730-6827066cfff2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:00.617013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-75bf2d1a-b1c8-4d43-9730-6827066cfff2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:00.906702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-75bf2d1a-b1c8-4d43-9730-6827066cfff2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/action" status: 200 len: 28665 microversion: 2.1 time: 0.308008 Jul 18 14:13:00.907354 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 227/472] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:13:00 2022] POST /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/action => generated 28665 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:13:02.407504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=9 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:02.408263 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=85 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:02.412786 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1aafcdb6-f628-4915-a898-a0a434b2ea90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:02.413786 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1aafcdb6-f628-4915-a898-a0a434b2ea90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:02.420730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1aafcdb6-f628-4915-a898-a0a434b2ea90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:02.421105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1aafcdb6-f628-4915-a898-a0a434b2ea90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:02.421904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1aafcdb6-f628-4915-a898-a0a434b2ea90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:02.422861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1aafcdb6-f628-4915-a898-a0a434b2ea90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:02.539928 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1aafcdb6-f628-4915-a898-a0a434b2ea90 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action" status: 200 len: 28726 microversion: 2.1 time: 0.134414 Jul 18 14:13:02.540824 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 246/473] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:13:02 2022] POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action => generated 28726 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:13:11.832900 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6b00bc88-4932-4159-9cb5-212d10e45a61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:11.833478 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6b00bc88-4932-4159-9cb5-212d10e45a61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:11.835957 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:11.836609 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:11.843181 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b00bc88-4932-4159-9cb5-212d10e45a61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:11.844302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b00bc88-4932-4159-9cb5-212d10e45a61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:11.845067 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b00bc88-4932-4159-9cb5-212d10e45a61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:11.845503 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b00bc88-4932-4159-9cb5-212d10e45a61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:11.869695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6b00bc88-4932-4159-9cb5-212d10e45a61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/ips" status: 200 len: 148 microversion: 2.1 time: 0.040988 Jul 18 14:13:11.870256 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 228/474] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:13:11 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:13.498191 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-42dd413f-25c2-446f-b302-6b1550d15d23 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:13.498701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-42dd413f-25c2-446f-b302-6b1550d15d23 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:13.501222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:13.501871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=4 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:13.508184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42dd413f-25c2-446f-b302-6b1550d15d23 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:13.508637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42dd413f-25c2-446f-b302-6b1550d15d23 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:13.509410 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42dd413f-25c2-446f-b302-6b1550d15d23 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:13.509847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-42dd413f-25c2-446f-b302-6b1550d15d23 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:13.533727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-42dd413f-25c2-446f-b302-6b1550d15d23 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/ips" status: 200 len: 144 microversion: 2.1 time: 0.039792 Jul 18 14:13:13.534290 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 247/475] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:13:13 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:19.546182 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e50ef6eb-e74e-4622-8a3b-06e7fdd66db7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fe24c76-1068-47c8-919c-5468a15f8c55"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:19.547446 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e50ef6eb-e74e-4622-8a3b-06e7fdd66db7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:19.553639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e50ef6eb-e74e-4622-8a3b-06e7fdd66db7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:19.554086 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e50ef6eb-e74e-4622-8a3b-06e7fdd66db7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:19.554834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e50ef6eb-e74e-4622-8a3b-06e7fdd66db7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:19.555261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e50ef6eb-e74e-4622-8a3b-06e7fdd66db7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:19.817130 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e50ef6eb-e74e-4622-8a3b-06e7fdd66db7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274359 Jul 18 14:13:19.818002 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 229/476] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:13:19 2022] POST /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:22.026700 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-731f6ae8-f0bc-40e4-b6bb-0f4a20f73408 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77ac1acf-c0fe-41a0-9a66-8b5b412728f0"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:22.027789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-731f6ae8-f0bc-40e4-b6bb-0f4a20f73408 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:22.034821 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-731f6ae8-f0bc-40e4-b6bb-0f4a20f73408 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:22.035306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-731f6ae8-f0bc-40e4-b6bb-0f4a20f73408 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:22.036103 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-731f6ae8-f0bc-40e4-b6bb-0f4a20f73408 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:22.036531 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-731f6ae8-f0bc-40e4-b6bb-0f4a20f73408 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:22.314341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-731f6ae8-f0bc-40e4-b6bb-0f4a20f73408 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291395 Jul 18 14:13:22.314929 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 248/477] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:13:22 2022] POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:22.582728 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:22.583293 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:22.589392 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:22.589831 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:22.590572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:22.591030 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:22.667599 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lazy-loading 'services' on Instance uuid 84e89663-a166-4505-83e7-f80979408077 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:13:22.741290 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bc296f22-c2ca-4213-8c81-f755b7b8f449 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "DELETE /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077/os-volume_attachments/040fca24-bcaf-4362-9495-57619d7ee33f" status: 202 len: 0 microversion: 2.1 time: 0.163884 Jul 18 14:13:22.742055 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 230/478] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:13:22 2022] DELETE /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077/os-volume_attachments/040fca24-bcaf-4362-9495-57619d7ee33f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:13:31.587501 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e12d8a95-d79b-4bb3-853c-067bf79cb12d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: .version_select at 0x7f7b3b458ca0>, body: {"keypair": {"name": "tempest-keypair-837356823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpPms/XgcmGSir7cNW2JA7SDn10/vbB4UsuxhwdF1ODY13vhHdh6Q8MuC36W7IAXB90+zKCD2NpIyy008F8tY8ETEsul+eQ+xXLXmomgObY314FeXSkkqXQLpI9hXMr/A=="}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:31.602707 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-e12d8a95-d79b-4bb3-853c-067bf79cb12d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:13:31.606919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-e12d8a95-d79b-4bb3-853c-067bf79cb12d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:13:31.632666 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e12d8a95-d79b-4bb3-853c-067bf79cb12d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049834 Jul 18 14:13:31.633293 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 249/479] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:13:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:33.150219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1278813586", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee89766c-7eb8-4f64-a3df-79441574b226"}], "security_groups": [{"name": "tempest-securitygroup--1231096573"}], "key_name": "tempest-keypair-837356823", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:33.157629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:33.158325 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:33.428372 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] validate_networks() for [('ee89766c-7eb8-4f64-a3df-79441574b226', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:13:33.797184 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:13:33.797605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:13:33.798078 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:13:33.798482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:13:33.798893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:13:33.808035 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:33.808439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:33.809236 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:33.809669 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:33.826737 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:13:33.830969 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:13:33.845753 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:13:33.848134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:13:33.898690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ae392064-e208-4c7f-a03b-a8e2857ea50b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.752943 Jul 18 14:13:33.900033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 231/480] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:13:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:13:33.908000 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:33.912805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b21a9dcd-e37e-45fc-8496-0bc648bbfa75 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:33.917164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b21a9dcd-e37e-45fc-8496-0bc648bbfa75 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:34.137102 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b21a9dcd-e37e-45fc-8496-0bc648bbfa75 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:34.144629 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b21a9dcd-e37e-45fc-8496-0bc648bbfa75 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1241 microversion: 2.1 time: 0.237920 Jul 18 14:13:34.145183 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 250/481] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:33 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1241 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:35.161972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:35.162632 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:35.170397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:35.170901 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:35.172299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:35.172730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:35.236251 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:35.244478 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-87ccd49f-159d-4401-8ebf-9a5386e8bd89 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1293 microversion: 2.1 time: 0.086794 Jul 18 14:13:35.245394 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 232/482] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:35 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:36.262528 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:36.263741 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:36.271712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:36.272422 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:36.273357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:36.273971 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:36.505424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:36.519671 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-af9eadac-421b-4526-b3b5-4c2b83d699d9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.261525 Jul 18 14:13:36.520613 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 251/483] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:36 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:36.885005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-7cb3be6d-9625-481e-9129-764a9f2fa666 req-0851eb82-cd3f-4290-b89c-6bc5338a4510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639f06f6-c59c-437e-864e-40716395ea05", "tag": "f65ef25d-1a47-4cd7-aec4-f7eb864fc86f"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:36.903978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-7cb3be6d-9625-481e-9129-764a9f2fa666 req-0851eb82-cd3f-4290-b89c-6bc5338a4510 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:36.908449 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-7cb3be6d-9625-481e-9129-764a9f2fa666 req-0851eb82-cd3f-4290-b89c-6bc5338a4510 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:36.930889 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-7cb3be6d-9625-481e-9129-764a9f2fa666 req-0851eb82-cd3f-4290-b89c-6bc5338a4510 service nova] Creating event network-changed:f65ef25d-1a47-4cd7-aec4-f7eb864fc86f for instance 639f06f6-c59c-437e-864e-40716395ea05 on hv-cinder-84984 Jul 18 14:13:36.937228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-7cb3be6d-9625-481e-9129-764a9f2fa666 req-0851eb82-cd3f-4290-b89c-6bc5338a4510 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056864 Jul 18 14:13:36.938337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 233/484] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:37.751001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:13:37.751173 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:13:37.755411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:37.758545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:37.765035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:37.765487 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:37.766911 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:37.767344 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:37.902409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:37.909969 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2ccae4fb-f16b-4078-9ead-7569c5ac9366 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.376599 Jul 18 14:13:37.910670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 252/485] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:37 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:38.928279 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:38.928973 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:38.935862 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:38.936330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:38.937094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:38.937526 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:39.072010 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:39.079319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-552e6075-8578-4d03-9558-27f8acb1a766 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.155692 Jul 18 14:13:39.079876 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 234/486] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:38 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:39.365520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dc590508-418c-4fab-afcd-579dfeaff3be tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:39.371871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc590508-418c-4fab-afcd-579dfeaff3be tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:39.372336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc590508-418c-4fab-afcd-579dfeaff3be tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:39.430847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dc590508-418c-4fab-afcd-579dfeaff3be tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Going to try to stop instance {{(pid=117845) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 14:13:39.472656 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dc590508-418c-4fab-afcd-579dfeaff3be tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action" status: 202 len: 0 microversion: 2.1 time: 0.110769 Jul 18 14:13:39.473244 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 253/487] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:13:39 2022] POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:13:39.481112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:39.481717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:39.487738 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:39.488215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:39.488972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:39.489402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:39.621248 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:39.629598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e07f5ee5-3322-493f-912f-250f4f5e5a25 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.152212 Jul 18 14:13:39.630168 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 235/488] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:39 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:40.097391 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:40.098099 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:40.104439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:40.104885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:40.105708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:40.106153 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:40.234518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:40.241985 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-feddbd88-f411-4b49-9bab-d6f22e45ead5 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.149424 Jul 18 14:13:40.242544 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 254/489] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:40 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:40.646685 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:40.647363 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:40.653924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:40.654361 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:40.655106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:40.655536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:40.789541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:40.797519 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ab80d9aa-5894-48bf-92f1-e22c0b810ab5 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.154637 Jul 18 14:13:40.798072 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 236/490] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:40 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:41.258758 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:41.259304 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:41.265840 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:41.266330 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:41.267676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:41.268133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:41.397727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:41.405203 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cb7a8d90-2b53-4c16-af5b-57db20158b5c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.150423 Jul 18 14:13:41.405767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 255/491] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:41 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:41.814415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:41.815189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:41.821512 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:41.821957 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:41.822712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:41.823144 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:41.953730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:41.962292 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a674932e-c091-4a2e-abbb-fa044c7b80ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.151686 Jul 18 14:13:41.962987 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 237/492] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:41 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:42.423853 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:42.424903 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:42.431727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:42.432207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:42.432979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:42.433413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:42.583187 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:42.590427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b0fdc3a6-5b37-4477-b787-e23a51f16817 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.171799 Jul 18 14:13:42.590990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 256/493] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:42 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:42.979537 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:42.980284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:42.987409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:42.987866 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:42.988648 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:42.989075 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:43.124393 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:43.132869 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f852fc94-4a8f-41e9-a5c3-efae7d4316d9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.157293 Jul 18 14:13:43.133425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 238/494] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:42 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:43.607246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:43.607854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:43.610340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:43.616484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:43.616928 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:43.617691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:43.618123 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:43.747872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:43.755177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-be6405a9-961b-4052-9ee2-e3e0b339ea30 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.152523 Jul 18 14:13:43.755739 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 257/495] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:43 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:43.907018 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:43.907508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:43.910029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:43.910722 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:43.916611 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:43.917057 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:43.917821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:43.918253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:43.943589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:13:44.024700 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5ca44c30-60e2-4137-85f0-581833a5ba80 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "DELETE /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 204 len: 0 microversion: 2.1 time: 0.121047 Jul 18 14:13:44.025991 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 239/496] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:13:43 2022] DELETE /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:13:44.034991 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:44.035599 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:44.041737 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:44.042180 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:44.043338 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:44.043780 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:44.078847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-0b0ee709-1a64-4281-8814-b6ecf3f6a049 req-6918f9ed-709b-4f41-90d1-65f4e067d586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639f06f6-c59c-437e-864e-40716395ea05", "name": "network-vif-plugged", "status": "completed", "tag": "f65ef25d-1a47-4cd7-aec4-f7eb864fc86f"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:44.089209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-0b0ee709-1a64-4281-8814-b6ecf3f6a049 req-6918f9ed-709b-4f41-90d1-65f4e067d586 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:44.089650 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-0b0ee709-1a64-4281-8814-b6ecf3f6a049 req-6918f9ed-709b-4f41-90d1-65f4e067d586 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:44.101299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-0b0ee709-1a64-4281-8814-b6ecf3f6a049 req-6918f9ed-709b-4f41-90d1-65f4e067d586 service nova] Creating event network-vif-plugged:f65ef25d-1a47-4cd7-aec4-f7eb864fc86f for instance 639f06f6-c59c-437e-864e-40716395ea05 on hv-cinder-84984 Jul 18 14:13:44.106047 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-0b0ee709-1a64-4281-8814-b6ecf3f6a049 req-6918f9ed-709b-4f41-90d1-65f4e067d586 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031271 Jul 18 14:13:44.106631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 240/497] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:44.142309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:44.195615 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:44.203773 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7c50ca58-7bec-41af-9aa6-b3e8900bb2f7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1515 microversion: 2.1 time: 0.173390 Jul 18 14:13:44.204553 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 258/498] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:44 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:44.270621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:44.271313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:44.277578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:44.278053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:44.278839 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:44.279268 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:44.409026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:44.416885 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-44ff9118-53de-47cf-8e13-1cd762a6325e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.269305 Jul 18 14:13:44.417441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 241/499] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:44 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:13:44.772368 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:44.772981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:44.779350 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:44.779796 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:44.780591 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:44.781023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:44.911167 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:44.918461 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cb6c66b9-9432-46ea-b483-b6e59b23e78d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.150539 Jul 18 14:13:44.919020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 259/500] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:44 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:45.222125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:45.222655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:45.229041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:45.229477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:45.230219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:45.230642 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:45.355920 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:45.363782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f1cbf886-1845-4df8-8b16-52e6812bfeb5 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1515 microversion: 2.1 time: 0.145612 Jul 18 14:13:45.364389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 242/501] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:45 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1515 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:45.433869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:45.434474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:45.441124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:45.441571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:45.442332 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:45.442766 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:45.577852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:45.585712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-eeddff66-4f07-4409-a46c-ada140edd7ad tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.155897 Jul 18 14:13:45.586277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 260/502] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:45 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:45.935566 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:45.936205 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:45.942340 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:45.942807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:45.943582 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:45.944048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:46.069274 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:46.077564 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-268892bb-40ff-424e-8b6a-ce6b245a44c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.145868 Jul 18 14:13:46.078125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 243/503] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:45 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:46.381104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:46.381712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:46.388292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:46.388735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:46.389524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:46.389956 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:46.519186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:46.526560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-59620a5d-d68b-4baf-b37a-cda7842d97a7 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1515 microversion: 2.1 time: 0.149810 Jul 18 14:13:46.527116 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 261/504] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:46 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:46.602499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:46.603108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:46.609602 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:46.610050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:46.610806 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:46.611244 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:46.735904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:46.744546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ba42791d-6515-4298-b7f4-e6e88a659390 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.145840 Jul 18 14:13:46.745105 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 244/505] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:46 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:47.098035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:47.098673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:47.104652 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:47.105101 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:47.105855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:47.106292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:47.266342 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:47.275402 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-71054552-7168-4a61-a1f7-4cffb05bc79a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1367 microversion: 2.1 time: 0.181723 Jul 18 14:13:47.275987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 262/506] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:47 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:47.558685 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:47.559305 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:47.570629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:47.571077 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:47.571870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:47.572331 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:47.675228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da8ecff90e714e4e961f8a8104143f62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f6e581c160d4e64a81e0b35907cc078', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:47.683281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d8bfeaa2-7e99-481d-96b8-be212b98d936 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 200 len: 1473 microversion: 2.1 time: 0.142535 Jul 18 14:13:47.683937 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 245/507] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:47 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 1473 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:47.724575 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-57a96db1-e5ae-4a4a-ae89-46c9332ec6d3 req-0bafeba8-fce3-4d16-a1e1-b896e9400498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e89663-a166-4505-83e7-f80979408077", "name": "network-vif-deleted", "tag": "5d278c35-21f0-4071-9f02-a94ec22d3ce8"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:47.732995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-57a96db1-e5ae-4a4a-ae89-46c9332ec6d3 req-0bafeba8-fce3-4d16-a1e1-b896e9400498 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:47.733428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-57a96db1-e5ae-4a4a-ae89-46c9332ec6d3 req-0bafeba8-fce3-4d16-a1e1-b896e9400498 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:47.746029 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-57a96db1-e5ae-4a4a-ae89-46c9332ec6d3 req-0bafeba8-fce3-4d16-a1e1-b896e9400498 service nova] Creating event network-vif-deleted:5d278c35-21f0-4071-9f02-a94ec22d3ce8 for instance 84e89663-a166-4505-83e7-f80979408077 on hv-cinder-84984 Jul 18 14:13:47.751011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-57a96db1-e5ae-4a4a-ae89-46c9332ec6d3 req-0bafeba8-fce3-4d16-a1e1-b896e9400498 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030728 Jul 18 14:13:47.751559 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 263/508] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:47.761895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:47.762505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:47.769034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:47.769483 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:47.770237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:47.770670 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:47.899289 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:47.907177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7d22caf6-6466-4313-931d-76c9faaabb3f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.149078 Jul 18 14:13:47.907735 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 246/509] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:47 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:48.293417 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:48.294175 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:48.300405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.300850 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.301611 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.302041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.428064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:48.435596 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6205e0dd-8591-4fbb-93f7-e83fe80e3a7d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1555 microversion: 2.1 time: 0.146562 Jul 18 14:13:48.436186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 264/510] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:48 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:48.452053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d48d8f6c-b9d4-4d36-b19b-6f416dfa0b4c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:48.452542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d48d8f6c-b9d4-4d36-b19b-6f416dfa0b4c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:48.459007 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d48d8f6c-b9d4-4d36-b19b-6f416dfa0b4c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.459445 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d48d8f6c-b9d4-4d36-b19b-6f416dfa0b4c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.460226 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d48d8f6c-b9d4-4d36-b19b-6f416dfa0b4c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.460654 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d48d8f6c-b9d4-4d36-b19b-6f416dfa0b4c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.536488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d48d8f6c-b9d4-4d36-b19b-6f416dfa0b4c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088140 Jul 18 14:13:48.537069 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 247/511] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:13:48 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:48.701617 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:48.702436 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] [instance: 84e89663-a166-4505-83e7-f80979408077] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:48.709993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.710433 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.711227 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.711638 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.728152 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] HTTP exception thrown: Instance 84e89663-a166-4505-83e7-f80979408077 could not be found. Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Request method failure captured: Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 HTTP/1.1 Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WmkZ_JvQH5UE042BAFhaC-ChkUU3FRfTPLoUhPaxikLjkK0yEbCydHuqXVoXsV2VgFDCp1jmig5o99DkfctNIx3XgPROqB03yOC-GHFqfJNG_WLWRMH7nrZkjTYqgZzL4X-7gVB-7RNhxdtTDEuOCvlPZ9uKWOx4wUPMr6Ph38jynY Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 9f6e581c160d4e64a81e0b35907cc078 Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesSnapshotTestJSON-405527568 Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:13:48.730091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9f6e581c160d4e64a81e0b35907cc078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9f6e581c160d4e64a81e0b35907cc078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9f6e581c160d4e64a81e0b35907cc078"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9f6e581c160d4e64a81e0b35907cc078"}]}] Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesSnapshotTestJSON-405527568 Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 9f6e581c160d4e64a81e0b35907cc078 Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-405527568 Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesSnapshotTestJSON-405527568-project Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: da8ecff90e714e4e961f8a8104143f62 Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesSnapshotTestJSON-405527568-project Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 84e89663-a166-4505-83e7-f80979408077 could not be found. Jul 18 14:13:48.731612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '84e89663-a166-4505-83e7-f80979408077'} Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e89663-a166-4505-83e7-f80979408077 could not be found. Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:13:48.732867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e89663-a166-4505-83e7-f80979408077 could not be found. Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e89663-a166-4505-83e7-f80979408077 could not be found. Jul 18 14:13:48.734114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:13:48.735186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] Returning 404 to user: Instance 84e89663-a166-4505-83e7-f80979408077 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:13:48.735186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-af8f6142-cc97-491d-b51c-3af7a32cc968 tempest-VolumesSnapshotTestJSON-405527568 tempest-VolumesSnapshotTestJSON-405527568-project] 10.222.0.94 "GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077" status: 404 len: 111 microversion: 2.1 time: 0.035308 Jul 18 14:13:48.735186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 265/512] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:48 2022] GET /compute/v2.1/servers/84e89663-a166-4505-83e7-f80979408077 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:13:48.925934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:48.927531 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:48.935154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.935607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.936515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:48.936958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:48.941931 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:49.240112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:49.249088 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dceb954c-7e50-4c81-b92d-a2248aeb742f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.328676 Jul 18 14:13:49.249725 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 248/513] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:48 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:49.851449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-f5a27f04-f11c-4cc4-88a5-f86e8a221e6b req-81751c39-7a9d-48d0-99af-11bbf659f61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639f06f6-c59c-437e-864e-40716395ea05", "tag": "f65ef25d-1a47-4cd7-aec4-f7eb864fc86f"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:49.859489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-f5a27f04-f11c-4cc4-88a5-f86e8a221e6b req-81751c39-7a9d-48d0-99af-11bbf659f61f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:49.859920 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-f5a27f04-f11c-4cc4-88a5-f86e8a221e6b req-81751c39-7a9d-48d0-99af-11bbf659f61f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:49.870743 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-f5a27f04-f11c-4cc4-88a5-f86e8a221e6b req-81751c39-7a9d-48d0-99af-11bbf659f61f service nova] Creating event network-changed:f65ef25d-1a47-4cd7-aec4-f7eb864fc86f for instance 639f06f6-c59c-437e-864e-40716395ea05 on hv-cinder-84984 Jul 18 14:13:49.875656 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-f5a27f04-f11c-4cc4-88a5-f86e8a221e6b req-81751c39-7a9d-48d0-99af-11bbf659f61f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027952 Jul 18 14:13:49.876269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 266/514] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:13:50.266923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:50.267546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:50.277821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:50.278488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:50.280292 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:50.281035 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:50.546773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:50.556278 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-09e76c09-6670-40cb-9888-d8f3be6cccbd tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.293403 Jul 18 14:13:50.556984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 249/515] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:50 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:51.575112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:51.577896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:51.585775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:51.586210 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:51.586968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:51.587394 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:51.713669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:51.721498 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-05bfe7ef-f021-4f53-9f35-4eb0a5a189f8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.151760 Jul 18 14:13:51.722048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 267/516] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:51 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:52.739879 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:52.740498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:52.747081 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:52.747531 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:52.748321 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:52.748755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:52.876590 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:52.885067 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bb73e31c-2c3b-4d0c-92c2-4d172a67f97c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.150294 Jul 18 14:13:52.885622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 250/517] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:52 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:53.901812 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:53.902409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:53.909157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:53.909594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:53.910344 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:53.910769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:53.928797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:54.042804 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:54.051171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a61b867e-c865-46e3-b09f-7c8f8b0f2912 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.153369 Jul 18 14:13:54.051725 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 268/518] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:53 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:55.068262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:55.068900 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:55.075476 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:55.075923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:55.076720 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:55.077152 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:55.202245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:55.210058 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-110fd82a-df46-4ef5-8eea-3ecd0a76bd08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.146322 Jul 18 14:13:55.210617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 251/519] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:55 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:56.227049 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:56.227653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:56.234264 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:56.234716 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:56.235476 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:56.235906 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:56.366337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:56.374935 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-64f6a625-1e39-4058-adf0-5df48ede8fbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.151722 Jul 18 14:13:56.375496 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 269/520] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:56 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:57.392020 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:57.393131 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:57.399633 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:57.400103 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:57.400848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:57.401273 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:57.528918 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:57.537581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e9980d32-c7d9-4b0e-8d0c-a1d293a67e82 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1722 microversion: 2.1 time: 0.149351 Jul 18 14:13:57.538167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 252/521] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:57 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:58.554628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:58.555427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:58.561892 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:58.562341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:58.563106 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:58.563538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:58.692583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:58.700385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6d833554-9eca-4b85-b617-031a8e400275 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1699 microversion: 2.1 time: 0.149707 Jul 18 14:13:58.700948 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 270/522] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:58 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1699 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:58.717040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5320445f-540e-402f-a5e9-c8e86126511e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:13:58.724255 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5320445f-540e-402f-a5e9-c8e86126511e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:58.724696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5320445f-540e-402f-a5e9-c8e86126511e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:58.781653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5320445f-540e-402f-a5e9-c8e86126511e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Going to try to start instance {{(pid=117846) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 14:13:58.821810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5320445f-540e-402f-a5e9-c8e86126511e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action" status: 202 len: 0 microversion: 2.1 time: 0.108405 Jul 18 14:13:58.822313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 253/523] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:13:58 2022] POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:13:58.830584 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:58.831188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:13:58.837161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:58.837610 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:58.838402 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:13:58.838834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:13:58.974749 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:13:58.982764 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b48549cf-8c1a-4fe3-a8fd-379f787d1769 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1708 microversion: 2.1 time: 0.156055 Jul 18 14:13:58.983326 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 271/524] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:58 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:00.002147 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:00.002854 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:00.009092 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:00.009540 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:00.010302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:00.010735 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:00.138573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:00.147108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4560b0af-f7d5-4d40-8aa8-b2b529063d1f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1708 microversion: 2.1 time: 0.150191 Jul 18 14:14:00.147668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 254/525] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:13:59 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:01.164127 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:01.164734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:01.171205 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:01.171643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:01.172426 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:01.172857 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:01.302336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:01.310440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a60c0644-d1c0-476d-a291-740f953b55e9 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1708 microversion: 2.1 time: 0.150159 Jul 18 14:14:01.311004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 272/526] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:01 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:02.328666 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:02.329209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:02.336275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:02.336743 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:02.337527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:02.337955 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:02.462871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:02.470697 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-757bf5d3-5124-4b07-933f-da3b647d0d7b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1708 microversion: 2.1 time: 0.145969 Jul 18 14:14:02.471592 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 255/527] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:02 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1708 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:03.488002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:03.488589 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:03.495016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:03.495461 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:03.496249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:03.496681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:03.629973 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:03.637983 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-61cd2041-9ab8-425f-bd21-ff8aa65c036d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1708 microversion: 2.1 time: 0.154325 Jul 18 14:14:03.638474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 273/528] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:03 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:04.654749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:04.655352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:04.658318 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:04.663534 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:04.664001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:04.664766 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:04.665198 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:04.794412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:04.802696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-abff3580-00b2-4310-b14b-1253e551c27e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1708 microversion: 2.1 time: 0.151834 Jul 18 14:14:04.803253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 256/529] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:04 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:05.820325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:05.820957 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:05.827344 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:05.827792 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:05.828632 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:05.829059 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:05.966361 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:05.974576 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b6b86179-2c3e-4c43-9d57-ac5476dba7ea tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1712 microversion: 2.1 time: 0.158061 Jul 18 14:14:05.975122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 274/530] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:05 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1712 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:14:25.578291 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:25.580601 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:25.779017 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-31eb3e58-ce63-4258-82b4-2e85067702de tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Action: 'create', calling method: .version_select at 0x7f7b3b331af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-843152289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKC/MaRCeZ0zr9sJRN9gYj882naLVCmIjFKzh2OjVG4uOwGmVVF5RSkFDZdqdlW6JmNKl8kQdpJNG7coR6n5/WcFFzM22yTUzxekdvgsn3ODNAn33WygeCmFdmeWYTZLcA=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:14:25.795076 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-31eb3e58-ce63-4258-82b4-2e85067702de tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:14:25.800167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-31eb3e58-ce63-4258-82b4-2e85067702de tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for user 35334a0f92254b5e900aad8c51873809 and project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:14:25.849895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-31eb3e58-ce63-4258-82b4-2e85067702de tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.276548 Jul 18 14:14:25.850739 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 257/531] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:14:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:14:37.874453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=35 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:37.875198 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=38 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:37.978342 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f37bbd56-a3d9-4961-add8-70059bbe3082 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bbe4ea0-06a2-4f1b-a4e1-df7364b44b72"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:14:37.979451 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f37bbd56-a3d9-4961-add8-70059bbe3082 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:37.985584 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f37bbd56-a3d9-4961-add8-70059bbe3082 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:37.986024 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f37bbd56-a3d9-4961-add8-70059bbe3082 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:37.986772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f37bbd56-a3d9-4961-add8-70059bbe3082 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:37.987198 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f37bbd56-a3d9-4961-add8-70059bbe3082 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:38.251802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f37bbd56-a3d9-4961-add8-70059bbe3082 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381880 Jul 18 14:14:38.252434 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 275/532] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:14:37 2022] POST /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:14:47.838908 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:47.839672 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:47.844076 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:14:47.845059 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:47.852392 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:47.852840 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:47.853606 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:47.854042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:47.877586 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lazy-loading 'flavor' on Instance uuid cfcc3bf9-291d-4700-bd55-f2116a5be826 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:14:48.001058 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c79f898e-509b-479a-8e07-3f5f434e88f1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/action" status: 200 len: 32 microversion: 2.1 time: 0.163196 Jul 18 14:14:48.001654 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 258/533] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:14:47 2022] POST /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:14:48.011381 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:48.012202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:48.014893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:48.021356 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:48.021921 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:48.022686 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:48.023328 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:48.240230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:48.248301 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7c94cf5c-60ba-4a7d-94a8-e36c8d1f18f2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.241080 Jul 18 14:14:48.248954 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 276/534] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:48 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:49.266842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:49.267581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:49.273622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:49.274067 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:49.274822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:49.275254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:49.404710 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:49.412528 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-88040b27-cf31-485c-a17d-d528e94ce6b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.150783 Jul 18 14:14:49.413272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 259/535] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:49 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:50.429655 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:50.430256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:50.436738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:50.437205 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:50.437964 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:50.438394 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:50.564046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:50.571775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-10b292ff-b46e-4671-94ce-81c4962a081c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.146176 Jul 18 14:14:50.572368 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 277/536] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:50 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:51.589300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:51.589841 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:51.596819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:51.597273 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:51.598039 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:51.598502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:51.726460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:51.734902 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-da592add-6b9c-483c-be43-ce9bbb7f1214 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.149476 Jul 18 14:14:51.735467 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 260/537] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:51 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:52.753491 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:52.754015 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:52.760448 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:52.760895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:52.761659 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:52.762092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:52.887750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:52.902143 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-047eb30e-88ef-4c1b-a513-e4d1367cb2b2 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.152997 Jul 18 14:14:52.902712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 278/538] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:52 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:53.573333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-602864950", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-843152289", "security_groups": [{"name": "tempest-secgroup-smoke-1037340211"}], "block_device_mapping_v2": [{"uuid": "0c613f03-0485-4509-acb9-4a6481adffec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40dc5af3-b7d1-47c8-a36a-5d52ad3762ee"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:14:53.697047 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] validate_networks() for [('40dc5af3-b7d1-47c8-a36a-5d52ad3762ee', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:14:53.918618 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:53.919211 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:53.925425 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:53.925861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:53.926617 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:53.927039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:54.132045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:54.140427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fc9dca12-b80a-4d8e-844c-d273cf71fe6b tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.225560 Jul 18 14:14:54.140987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 279/539] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:53 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:14:54.228348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:14:54.228763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:14:54.229228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:14:54.229625 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:14:54.230027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:14:54.238684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:54.239118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:54.239890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:54.240349 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:54.257739 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:14:54.261598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for user 35334a0f92254b5e900aad8c51873809 and project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:14:54.317645 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:14:54.319722 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c613f03-0485-4509-acb9-4a6481adffec',volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:14:54.444492 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4cb305c1-c4cd-4974-ab73-b3686ccd8ffa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874909 Jul 18 14:14:54.445291 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 261/540] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:14:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:14:54.455633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d2373464-c026-453a-8ce5-07ce8ce4af71 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:54.456251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d2373464-c026-453a-8ce5-07ce8ce4af71 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:54.507115 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d2373464-c026-453a-8ce5-07ce8ce4af71 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:54.513708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d2373464-c026-453a-8ce5-07ce8ce4af71 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1093 microversion: 2.1 time: 0.062511 Jul 18 14:14:54.514270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 280/541] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:54 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:55.158433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:55.159033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:55.165111 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:55.165558 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:55.166314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:55.166742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:55.291519 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:55.300117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6c2b5fd0-1ecc-414d-96cd-72b6c9a29340 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.146455 Jul 18 14:14:55.300716 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 262/542] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:55 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:55.532540 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2ac4db70-8a6f-42d2-9ef9-e25c75fdec86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:55.533062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2ac4db70-8a6f-42d2-9ef9-e25c75fdec86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:55.589018 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2ac4db70-8a6f-42d2-9ef9-e25c75fdec86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:55.596345 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2ac4db70-8a6f-42d2-9ef9-e25c75fdec86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1093 microversion: 2.1 time: 0.069368 Jul 18 14:14:55.596907 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 281/543] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:55 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:56.317461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:56.317980 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:56.324885 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:56.325326 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:56.326070 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:56.326485 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:56.455384 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:56.463233 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c2dd1698-7f65-4e8e-bb88-d3652c2889b1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.149729 Jul 18 14:14:56.463787 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 263/544] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:56 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:56.613131 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-25a69245-2509-4b62-b2eb-04de6ae6c750 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:56.613653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-25a69245-2509-4b62-b2eb-04de6ae6c750 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:56.668718 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-25a69245-2509-4b62-b2eb-04de6ae6c750 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:56.675532 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-25a69245-2509-4b62-b2eb-04de6ae6c750 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1093 microversion: 2.1 time: 0.066265 Jul 18 14:14:56.676118 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 282/545] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:56 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:57.480284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:57.480925 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:57.487969 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:57.488433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:57.489194 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:57.489627 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:57.618142 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:57.625941 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6f310ce5-ac0c-4500-a757-6f2cfb80a289 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.149484 Jul 18 14:14:57.626498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 264/546] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:57 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:57.692357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fda3d7d8-b5fc-4473-a5be-5ffeac1e3d8f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:57.692885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fda3d7d8-b5fc-4473-a5be-5ffeac1e3d8f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:57.744933 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fda3d7d8-b5fc-4473-a5be-5ffeac1e3d8f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:57.751601 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fda3d7d8-b5fc-4473-a5be-5ffeac1e3d8f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1093 microversion: 2.1 time: 0.063151 Jul 18 14:14:57.752192 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 283/547] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:57 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:14:58.642561 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:58.643159 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:58.649611 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:58.650050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:58.650940 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:58.651387 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:58.767601 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:58.768364 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:58.774846 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:58.775017 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:58.775290 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:58.776081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:58.776511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:58.783330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d1f86e6e-01fc-4dd6-89b9-50a33ad95cc4 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.144607 Jul 18 14:14:58.784264 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 265/548] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:58 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:14:58.839576 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:58.847402 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-da090593-bedd-4099-af1f-e361b9662adf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1143 microversion: 2.1 time: 0.083623 Jul 18 14:14:58.847984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 284/549] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:58 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:14:59.802748 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:59.803380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:59.809913 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:59.810365 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:59.811135 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:59.811568 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:59.863682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:14:59.864336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:14:59.870918 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:59.871556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:59.872435 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:14:59.872919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:14:59.955843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:14:59.963439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-38723e8e-a39b-4d52-acc0-54ec9dfef653 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1209 microversion: 2.1 time: 0.103519 Jul 18 14:14:59.964263 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 285/550] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:59 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:00.024234 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:00.033548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bdcdfa3a-329c-44fb-99b2-6863e989608d tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.236460 Jul 18 14:15:00.034117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 266/551] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:14:59 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:00.981069 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:00.981681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:00.988705 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:00.989151 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:00.989926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:00.990363 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:01.051139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:01.051869 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:01.058643 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:01.059093 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:01.059863 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:01.060324 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:01.281455 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:01.288802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ba88abdc-7b6c-4817-b91b-fd7d43ca0bbc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.311577 Jul 18 14:15:01.289366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 286/552] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:00 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:01.317427 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:01.325824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2f11bf1c-2c49-4e06-9814-de342f9e4ca3 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.278489 Jul 18 14:15:01.327053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 267/553] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:01 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:01.665961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-3ec2c37c-f5c0-41b2-9beb-0b05561df2e6 req-93b7a58a-ad56-4626-a30a-c2c2413a9afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5b2707-4b87-4dbd-b986-13ec52ee0f47", "tag": "aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:01.675591 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-3ec2c37c-f5c0-41b2-9beb-0b05561df2e6 req-93b7a58a-ad56-4626-a30a-c2c2413a9afa service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:01.676065 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-3ec2c37c-f5c0-41b2-9beb-0b05561df2e6 req-93b7a58a-ad56-4626-a30a-c2c2413a9afa service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:01.689273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-3ec2c37c-f5c0-41b2-9beb-0b05561df2e6 req-93b7a58a-ad56-4626-a30a-c2c2413a9afa service nova] Creating event network-changed:aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c for instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 on hv-cinder-84984 Jul 18 14:15:01.695115 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-3ec2c37c-f5c0-41b2-9beb-0b05561df2e6 req-93b7a58a-ad56-4626-a30a-c2c2413a9afa service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106428 Jul 18 14:15:01.695717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 287/554] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:15:02.306809 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:02.307358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:02.314489 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:02.314938 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:02.315706 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:02.316174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:02.343815 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:02.344658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:02.351256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:02.351703 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:02.352503 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:02.352942 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:02.494812 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:02.502215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-887cbb60-37cf-45ff-adef-159a252a1e00 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.199332 Jul 18 14:15:02.502785 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 268/555] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:02 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:02.529037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:02.537256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7ce8d864-fb07-433c-b969-4ae550719f55 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.197574 Jul 18 14:15:02.537807 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 288/556] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:02 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:03.518526 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:03.519139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:03.525583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:03.526026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:03.526801 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:03.527237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:03.554759 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:03.555284 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:03.561738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:03.562177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:03.562938 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:03.563361 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:03.808227 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:03.815736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7b4a318c-34e8-4210-99b1-098934015770 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.301073 Jul 18 14:15:03.816525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 269/557] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:03 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:03.823355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:03.831775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-50e3fa5e-8328-4f37-af7a-7c1c0ac3e9c5 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.281110 Jul 18 14:15:03.832438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 289/558] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:03 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:04.832198 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:04.832799 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:04.834717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:04.835362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:04.841467 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:04.841966 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:04.842720 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:04.843148 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:04.848847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:04.849450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:04.855908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:04.856384 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:04.857179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:04.857608 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:05.039626 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:05.046579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:05.048300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4e5a726d-73e1-4b98-9192-717b659ded2a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.219934 Jul 18 14:15:05.048867 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 270/559] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:04 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:05.054641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2f645c93-36bd-464e-95d1-a0378061f78c tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.209568 Jul 18 14:15:05.055199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 290/560] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:04 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:06.065314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:06.065971 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:06.072266 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:06.072759 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:06.072870 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:06.073028 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:06.073798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:06.074234 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:06.079914 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:06.080385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:06.081179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:06.081606 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:06.358086 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:06.361785 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:06.366253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4077eb38-3e31-4ea6-8d86-a0c3cad7f440 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.297958 Jul 18 14:15:06.367019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 291/561] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:06 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:06.369177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9212f9d8-7418-4e9f-835b-3a3ac36bf9d1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.307712 Jul 18 14:15:06.369730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 271/562] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:06 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:07.383651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:07.384289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:07.386051 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:07.386660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:07.391573 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:07.392055 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:07.392830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:07.393262 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:07.393586 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:07.394034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:07.394792 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:07.395226 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:07.589565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:07.593020 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:07.597864 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5f1e4741-4ed6-4570-a62c-f32705e9f1fc tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1734 microversion: 2.1 time: 0.218095 Jul 18 14:15:07.598533 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 292/563] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:07 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:07.600366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-83987c23-0e24-4a2e-88fb-b45599464ca4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.218038 Jul 18 14:15:07.600927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 272/564] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:07 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:08.616007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:08.616617 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:08.617058 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:08.617664 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:08.618572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=8 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:08.625178 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:08.625352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:08.625627 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:08.625737 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:08.626385 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:08.626488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:08.626839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:08.626957 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:08.629530 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:08.642720 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:08.826012 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:08.829869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:08.833640 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-90295887-b4ef-4461-8e77-dc18e84c9f2f tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.220246 Jul 18 14:15:08.834212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 273/565] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:08 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:08.838258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b694dbcd-8475-4e2c-828e-8a4ed07b34fb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1714 microversion: 2.1 time: 0.226139 Jul 18 14:15:08.838911 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 293/566] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:08 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1714 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:08.897773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:08.898276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:08.904316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:08.904760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:08.905516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:08.905942 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:08.984708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] HTTP exception thrown: Cannot 'detach_volume' instance cfcc3bf9-291d-4700-bd55-f2116a5be826 while it is in vm_state rescued Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Request method failure captured: Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments/3bbe4ea0-06a2-4f1b-a4e1-df7364b44b72 HTTP/1.1 Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wlqlb5vVhBtiN9LYhex0arcXaQaWB9pkT7ZYEGOQJ-C985AGyoC8hBJzCJ66LDgRu4P1-0_9agqg5KTCCRlUoseBHZGSGYgbe1f2ZGQSvpU9y18Rpook9YYagQtQhqVlGNL2-bPawldUfT9JkIv0i4AqmdfFsqImUsVaNGlQxCVvSU Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:15:08.986295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_eaf9f75abc034491bd1b8846c05bf625"}]}] Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 3720c2225b51464abee34d05a69b9db7 Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:15:08.987745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Cannot 'detach_volume' instance cfcc3bf9-291d-4700-bd55-f2116a5be826 while it is in vm_state rescued Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'server_id': 'cfcc3bf9-291d-4700-bd55-f2116a5be826', 'id': '3bbe4ea0-06a2-4f1b-a4e1-df7364b44b72'} Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cfcc3bf9-291d-4700-bd55-f2116a5be826 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:15:08.988469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cfcc3bf9-291d-4700-bd55-f2116a5be826 while it is in vm_state rescued Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cfcc3bf9-291d-4700-bd55-f2116a5be826 while it is in vm_state rescued Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:08.989795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Returning 409 to user: Cannot 'detach_volume' instance cfcc3bf9-291d-4700-bd55-f2116a5be826 while it is in vm_state rescued {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:15:08.990768 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5d70a5b9-9298-439e-9559-716754cd28b7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "DELETE /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments/3bbe4ea0-06a2-4f1b-a4e1-df7364b44b72" status: 409 len: 152 microversion: 2.1 time: 0.093860 Jul 18 14:15:08.990768 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 274/567] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:15:08 2022] DELETE /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments/3bbe4ea0-06a2-4f1b-a4e1-df7364b44b72 => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 14:15:08.996534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a563ecc8-9ef8-46a6-803b-75fade0dd2eb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:08.997092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a563ecc8-9ef8-46a6-803b-75fade0dd2eb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:09.003755 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a563ecc8-9ef8-46a6-803b-75fade0dd2eb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:09.004240 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a563ecc8-9ef8-46a6-803b-75fade0dd2eb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:09.004998 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a563ecc8-9ef8-46a6-803b-75fade0dd2eb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:09.005426 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a563ecc8-9ef8-46a6-803b-75fade0dd2eb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:09.072107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a563ecc8-9ef8-46a6-803b-75fade0dd2eb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "POST /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/action" status: 202 len: 0 microversion: 2.1 time: 0.079218 Jul 18 14:15:09.074781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 294/568] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:15:08 2022] POST /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:15:09.080809 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:09.081415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:09.089028 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:09.089480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:09.090245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:09.090680 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:09.223631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:09.231786 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ad35430e-2ad4-4a80-9b6a-4f1e4a95f7c7 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1722 microversion: 2.1 time: 0.154802 Jul 18 14:15:09.232904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 275/569] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:09 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:09.852027 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:09.852639 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:09.858901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:09.859350 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:09.860188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:09.860623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:09.994538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:10.002560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f95705e9-70e0-43a3-88c1-1f4ab7c2d2dc tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.155331 Jul 18 14:15:10.003118 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 295/570] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:09 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:10.250077 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:10.250682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:10.257154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:10.257598 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:10.258364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:10.258794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:10.497949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:10.506313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3673b2f1-852c-4bc9-8710-158be1ca574a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1722 microversion: 2.1 time: 0.260420 Jul 18 14:15:10.506752 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 276/571] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:10 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:11.018549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:11.019107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:11.025551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:11.025983 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:11.026729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:11.027155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:11.171618 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:11.179283 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5884804a-7ece-4c9f-8427-3a112160f061 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.164609 Jul 18 14:15:11.179837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 296/572] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:11 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:11.522485 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:11.523117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:11.529545 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:11.529977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:11.530722 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:11.531147 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:11.654509 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:11.662424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-50a27c2b-f844-475b-a1fb-2b7d2cbd8edb tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1722 microversion: 2.1 time: 0.143715 Jul 18 14:15:11.662973 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 277/573] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:11 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:12.195036 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:12.195634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:12.202212 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:12.202590 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:12.203374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:12.203801 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:12.334339 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:12.342429 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-075040a1-0aef-4d42-9e1f-33cc24af39f0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.151210 Jul 18 14:15:12.342990 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 297/574] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:12 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:12.679562 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:12.680195 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:12.686622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:12.687066 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:12.687827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:12.688285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:12.814860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:12.822604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-382b22ae-904f-4403-a0f0-9612da2af856 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1722 microversion: 2.1 time: 0.147154 Jul 18 14:15:12.823159 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 278/575] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:12 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:13.359171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:13.359980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:13.366727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:13.367172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:13.367936 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:13.368427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:13.495891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:13.503736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7f7b39c1-18d3-46b1-a633-22995ba5dd7b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.148931 Jul 18 14:15:13.504321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 298/576] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:13 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:13.840376 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:13.841436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:13.847860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:13.848345 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:13.849103 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:13.849538 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:13.979427 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:13.988171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f037ab8c-4d35-4181-881f-2230dda66b29 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1728 microversion: 2.1 time: 0.151916 Jul 18 14:15:13.988731 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 279/577] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:13 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:14.004459 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ce398f27-5c6f-4b1d-b5f7-1c7a24b942d6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:14.004949 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ce398f27-5c6f-4b1d-b5f7-1c7a24b942d6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:14.010926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ce398f27-5c6f-4b1d-b5f7-1c7a24b942d6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:14.011365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ce398f27-5c6f-4b1d-b5f7-1c7a24b942d6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:14.012147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ce398f27-5c6f-4b1d-b5f7-1c7a24b942d6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:14.012577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ce398f27-5c6f-4b1d-b5f7-1c7a24b942d6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:14.088555 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ce398f27-5c6f-4b1d-b5f7-1c7a24b942d6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087863 Jul 18 14:15:14.089136 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 299/578] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:15:13 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:14.520605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:14.521204 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:14.527393 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:14.528083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:14.528926 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:14.529529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:14.744677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-8f4edad8-ff4e-4fa0-89ad-136ee454b692 req-4a30a476-7704-4999-890f-b8d2b15fa989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5b2707-4b87-4dbd-b986-13ec52ee0f47", "name": "network-vif-plugged", "status": "completed", "tag": "aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:14.754783 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-8f4edad8-ff4e-4fa0-89ad-136ee454b692 req-4a30a476-7704-4999-890f-b8d2b15fa989 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:14.755261 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-8f4edad8-ff4e-4fa0-89ad-136ee454b692 req-4a30a476-7704-4999-890f-b8d2b15fa989 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:14.767610 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-8f4edad8-ff4e-4fa0-89ad-136ee454b692 req-4a30a476-7704-4999-890f-b8d2b15fa989 service nova] Creating event network-vif-plugged:aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c for instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 on hv-cinder-84984 Jul 18 14:15:14.772751 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-8f4edad8-ff4e-4fa0-89ad-136ee454b692 req-4a30a476-7704-4999-890f-b8d2b15fa989 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100291 Jul 18 14:15:14.773356 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 300/579] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:14.994888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:15.003229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-26b97b59-9910-49b5-a7b5-4437144b7757 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.486567 Jul 18 14:15:15.003799 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 280/580] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:14 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:15.327856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-6ef3afde-6018-4b20-ac20-d656d7ab20ed req-3da3d119-50c5-4046-a6e6-a040ebb26337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfcc3bf9-291d-4700-bd55-f2116a5be826", "tag": "b727dd55-3851-43a8-95d2-3c1008ebee22"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:15.338476 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-6ef3afde-6018-4b20-ac20-d656d7ab20ed req-3da3d119-50c5-4046-a6e6-a040ebb26337 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:15.339039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-6ef3afde-6018-4b20-ac20-d656d7ab20ed req-3da3d119-50c5-4046-a6e6-a040ebb26337 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:15.350479 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-6ef3afde-6018-4b20-ac20-d656d7ab20ed req-3da3d119-50c5-4046-a6e6-a040ebb26337 service nova] Creating event network-changed:b727dd55-3851-43a8-95d2-3c1008ebee22 for instance cfcc3bf9-291d-4700-bd55-f2116a5be826 on hv-cinder-84984 Jul 18 14:15:15.355289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-6ef3afde-6018-4b20-ac20-d656d7ab20ed req-3da3d119-50c5-4046-a6e6-a040ebb26337 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031436 Jul 18 14:15:15.355973 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 301/581] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:16.020237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:16.020859 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:16.027375 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:16.027826 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:16.029269 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:16.029740 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:16.165304 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:16.172810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7c85a7ba-053b-4723-bf25-fc3d4e4e0ef7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1265 microversion: 2.1 time: 0.156525 Jul 18 14:15:16.173374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 281/582] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:16 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:17.190631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:17.191353 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:17.197637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:17.198085 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:17.198853 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:17.199285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:17.329861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:17.337538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8ab7e859-1ced-4695-9b3c-fdc7842209aa tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1451 microversion: 2.1 time: 0.151628 Jul 18 14:15:17.338096 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 302/583] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:17 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:17.353820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:17.354436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:17.361088 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:17.361531 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:17.362287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:17.362717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:17.369408 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-c280671b-0d7c-478a-bdac-2da0f7aa8215 req-8adfad4b-544e-41ee-8314-882733a8c85e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfcc3bf9-291d-4700-bd55-f2116a5be826", "tag": "b727dd55-3851-43a8-95d2-3c1008ebee22"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:17.377337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-c280671b-0d7c-478a-bdac-2da0f7aa8215 req-8adfad4b-544e-41ee-8314-882733a8c85e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:17.377772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-c280671b-0d7c-478a-bdac-2da0f7aa8215 req-8adfad4b-544e-41ee-8314-882733a8c85e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:17.388359 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-c280671b-0d7c-478a-bdac-2da0f7aa8215 req-8adfad4b-544e-41ee-8314-882733a8c85e service nova] Creating event network-changed:b727dd55-3851-43a8-95d2-3c1008ebee22 for instance cfcc3bf9-291d-4700-bd55-f2116a5be826 on hv-cinder-84984 Jul 18 14:15:17.393133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-c280671b-0d7c-478a-bdac-2da0f7aa8215 req-8adfad4b-544e-41ee-8314-882733a8c85e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027314 Jul 18 14:15:17.393707 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 303/584] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:15:17.554162 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:17.561573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8fc524c1-a591-4f00-b00f-4c7cb8fc4c78 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1451 microversion: 2.1 time: 0.211493 Jul 18 14:15:17.562140 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 282/585] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:17 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1451 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:19.220300 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-1f48a003-0033-4e49-ae64-8e5f1f7695f8 req-fb09d07c-6838-45c9-837d-5cd2b9dd190e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5b2707-4b87-4dbd-b986-13ec52ee0f47", "tag": "aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:19.223829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=65 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:19.229833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-1f48a003-0033-4e49-ae64-8e5f1f7695f8 req-fb09d07c-6838-45c9-837d-5cd2b9dd190e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:19.230270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-1f48a003-0033-4e49-ae64-8e5f1f7695f8 req-fb09d07c-6838-45c9-837d-5cd2b9dd190e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:19.242908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-1f48a003-0033-4e49-ae64-8e5f1f7695f8 req-fb09d07c-6838-45c9-837d-5cd2b9dd190e service nova] Creating event network-changed:aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c for instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 on hv-cinder-84984 Jul 18 14:15:19.247762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-1f48a003-0033-4e49-ae64-8e5f1f7695f8 req-fb09d07c-6838-45c9-837d-5cd2b9dd190e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086518 Jul 18 14:15:19.248385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 304/586] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:23.452182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:15:23.452775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Mon Jul 18 14:15:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:15:25.756506 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:25.757072 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:25.759391 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:25.765516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:25.765965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:25.766723 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:25.767158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:25.846328 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lazy-loading 'services' on Instance uuid bc44e843-997b-458f-afa5-068509107496 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:15:25.916536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0a0101f3-1c2c-4418-acd1-36a813d0bd33 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-volume_attachments/77ac1acf-c0fe-41a0-9a66-8b5b412728f0" status: 202 len: 0 microversion: 2.1 time: 0.163931 Jul 18 14:15:25.917199 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 283/587] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:15:25 2022] DELETE /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-volume_attachments/77ac1acf-c0fe-41a0-9a66-8b5b412728f0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:27.033177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-09a2fdff-745b-4364-96bc-8bcd79545788 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:27.039469 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-09a2fdff-745b-4364-96bc-8bcd79545788 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:27.039913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-09a2fdff-745b-4364-96bc-8bcd79545788 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:27.063883 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-09a2fdff-745b-4364-96bc-8bcd79545788 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Going to try to stop instance {{(pid=117845) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 14:15:27.103134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-09a2fdff-745b-4364-96bc-8bcd79545788 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action" status: 202 len: 0 microversion: 2.1 time: 0.074669 Jul 18 14:15:27.103783 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 305/588] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:15:27 2022] POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:27.113717 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:27.114399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:27.120613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:27.121217 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:27.121975 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:27.122437 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:27.257017 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:27.265344 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f35b72ae-f890-4da4-9f44-b4b45b39b262 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.156339 Jul 18 14:15:27.265903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 284/589] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:27 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:28.284003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:28.284652 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:28.290880 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:28.291331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:28.292129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:28.292592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:28.419811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:28.427471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e2e15a64-d1ba-4fc0-82b5-e0b9f88be9f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.148288 Jul 18 14:15:28.428040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 306/590] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:28 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:29.444812 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:29.445421 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:29.452542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:29.452992 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:29.453747 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:29.454184 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:29.582743 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:29.590678 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6064a8ee-19cd-44f9-b17c-48d4ec5e2264 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.149799 Jul 18 14:15:29.591244 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 285/591] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:29 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:30.608112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:30.608644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:30.615207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:30.615651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:30.616439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:30.616874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:30.742465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:30.751145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f0a793d3-e883-4221-8ee0-a70349698399 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.147021 Jul 18 14:15:30.751708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 307/592] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:30 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:31.768331 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:31.768857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:31.775148 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:31.775585 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:31.776369 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:31.776793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:31.904224 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:31.911612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7e7988d8-e22c-4d4f-b3bb-740bf423ff3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.147132 Jul 18 14:15:31.912206 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 286/593] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:31 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:32.444919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f3e54585-dba3-4768-aeae-c9535ec9c0df tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:32.445441 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f3e54585-dba3-4768-aeae-c9535ec9c0df tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:32.452398 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e54585-dba3-4768-aeae-c9535ec9c0df tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.452846 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e54585-dba3-4768-aeae-c9535ec9c0df tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.453607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e54585-dba3-4768-aeae-c9535ec9c0df tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.454043 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f3e54585-dba3-4768-aeae-c9535ec9c0df tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.476014 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f3e54585-dba3-4768-aeae-c9535ec9c0df tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05/ips" status: 200 len: 148 microversion: 2.1 time: 0.035042 Jul 18 14:15:32.476565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 308/594] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:15:32 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05/ips => generated 148 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:32.487346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fe24c76-1068-47c8-919c-5468a15f8c55"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:32.488526 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:32.494515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.494957 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.496307 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.496751 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.573588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Invalid volume: volume 8fe24c76-1068-47c8-919c-5468a15f8c55 is already attached to instances: e8ef7fb3-7048-49b7-83f5-1342dcd057ef Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: POST /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05/os-volume_attachments HTTP/1.1 Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 74 Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:15:32.575285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {"volumeAttachment": {"volumeId": "8fe24c76-1068-47c8-919c-5468a15f8c55"}} Jul 18 14:15:32.576953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Invalid volume: volume 8fe24c76-1068-47c8-919c-5468a15f8c55 is already attached to instances: e8ef7fb3-7048-49b7-83f5-1342dcd057ef Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'server_id': '639f06f6-c59c-437e-864e-40716395ea05', 'body': {'volumeAttachment': {'volumeId': '8fe24c76-1068-47c8-919c-5468a15f8c55'}}} Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8fe24c76-1068-47c8-919c-5468a15f8c55 is already attached to instances: e8ef7fb3-7048-49b7-83f5-1342dcd057ef Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:32.578000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8fe24c76-1068-47c8-919c-5468a15f8c55 is already attached to instances: e8ef7fb3-7048-49b7-83f5-1342dcd057ef Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:32.579497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8fe24c76-1068-47c8-919c-5468a15f8c55 is already attached to instances: e8ef7fb3-7048-49b7-83f5-1342dcd057ef Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 400 to user: Invalid volume: volume 8fe24c76-1068-47c8-919c-5468a15f8c55 is already attached to instances: e8ef7fb3-7048-49b7-83f5-1342dcd057ef {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cf1880b8-4f4b-4c53-be69-88f663453e05 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093299 Jul 18 14:15:32.581280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 287/595] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:15:32 2022] POST /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:15:32.585247 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:32.585741 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:32.591796 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.592195 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.592953 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.593382 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.617371 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Going to try to terminate instance {{(pid=117845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:15:32.661217 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:32.693538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-004b86ef-3fec-4331-a834-d4d33fe67d10 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 204 len: 0 microversion: 2.1 time: 0.111628 Jul 18 14:15:32.694113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 309/596] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:15:32 2022] DELETE /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:15:32.702366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:32.702917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:32.709699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.710146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.710905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.711333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.842235 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:32.849548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f8cf68d2-5a1f-4094-982d-8a4914d7b60f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1680 microversion: 2.1 time: 0.151150 Jul 18 14:15:32.850100 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 288/597] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:32 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:32.930505 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:32.931186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:32.937366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.937809 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:32.938562 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:32.938992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:33.068915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:33.076799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4aee2fa1-f806-4893-95cc-a62d05d333ed tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.150510 Jul 18 14:15:33.077353 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 310/598] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:32 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:33.867589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:33.868129 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:33.875107 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:33.875546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:33.876330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:33.876763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:33.880836 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:34.008416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:34.015735 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d0b06ae0-b4c3-4a49-91c2-5f2772fcc555 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1680 microversion: 2.1 time: 0.152081 Jul 18 14:15:34.016328 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 289/599] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:33 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:34.093128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:34.093738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:34.100106 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:34.100549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:34.101310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:34.101747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:34.226249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:34.234117 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fc12c749-9b79-44c4-8da5-59eca50bb448 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.144886 Jul 18 14:15:34.234673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 311/600] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:34 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:35.035026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:35.035677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:35.042230 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:35.042679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:35.043441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:35.043903 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:35.250760 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:35.251362 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:35.257782 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:35.258227 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:35.258998 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:35.259430 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:35.567247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:35.574754 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2539ff3b-a7c9-436e-9360-fa72b98c4bbc tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1680 microversion: 2.1 time: 0.543789 Jul 18 14:15:35.575315 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 290/601] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:35 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1680 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:35.696304 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:35.704371 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-088cb5d1-b627-41be-86f8-20b96c01482b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.457380 Jul 18 14:15:35.704985 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 312/602] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:35 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:36.073799 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-81324d29-b086-403a-9c0f-c861909e1b02 req-e1a56e09-72ce-4f87-acc2-461d953ea458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639f06f6-c59c-437e-864e-40716395ea05", "name": "network-vif-deleted", "tag": "f65ef25d-1a47-4cd7-aec4-f7eb864fc86f"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:36.084410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-81324d29-b086-403a-9c0f-c861909e1b02 req-e1a56e09-72ce-4f87-acc2-461d953ea458 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:36.085156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-81324d29-b086-403a-9c0f-c861909e1b02 req-e1a56e09-72ce-4f87-acc2-461d953ea458 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:36.097729 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-81324d29-b086-403a-9c0f-c861909e1b02 req-e1a56e09-72ce-4f87-acc2-461d953ea458 service nova] Creating event network-vif-deleted:f65ef25d-1a47-4cd7-aec4-f7eb864fc86f for instance 639f06f6-c59c-437e-864e-40716395ea05 on hv-cinder-84984 Jul 18 14:15:36.102956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-81324d29-b086-403a-9c0f-c861909e1b02 req-e1a56e09-72ce-4f87-acc2-461d953ea458 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Jul 18 14:15:36.103865 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 291/603] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:36.592437 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:36.593823 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:36.600233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:36.600686 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:36.601451 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:36.602150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:36.634114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:36.634706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:36.635223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lazy-loading 'fault' on Instance uuid 639f06f6-c59c-437e-864e-40716395ea05 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:15:36.681495 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:36.689701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4c671cf1-35f9-4690-9506-c244741bf43c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 200 len: 1331 microversion: 2.1 time: 0.102007 Jul 18 14:15:36.699080 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 313/604] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:36 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:36.723756 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:36.724764 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:36.730944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:36.731456 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:36.733083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:36.733595 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:36.876535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:36.884583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ec8cf432-ac5b-4a04-8de8-684a2bbe73b8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.165056 Jul 18 14:15:36.885125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 292/605] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:36 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:37.706561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:37.707107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:37.713488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:37.713926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:37.714674 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:37.715097 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:37.727717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 HTTP/1.1 Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:15:37.729340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:15:37.730868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '639f06f6-c59c-437e-864e-40716395ea05'} Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:15:37.731849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:15:37.733890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:15:37.735465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:15:37.735465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8d73085b-99ce-4f32-b076-2d3d1388db92 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 404 len: 111 microversion: 2.1 time: 0.028016 Jul 18 14:15:37.735465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 314/606] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:37 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:15:37.740380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-abddaf11-d230-4a77-869b-6f1e61d7716d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '.version_select at 0x7f7b3b331550>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:37.759875 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-abddaf11-d230-4a77-869b-6f1e61d7716d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837356823" status: 202 len: 0 microversion: 2.1 time: 0.023250 Jul 18 14:15:37.760490 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 293/607] 10.222.0.94 () {58 vars in 1217 bytes} [Mon Jul 18 14:15:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837356823 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:37.902556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:37.903237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:37.910828 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:37.912695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:37.914075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:37.914520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:38.184910 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:38.192391 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1c9669f9-836c-447a-8a25-bf99a2eca045 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.294072 Jul 18 14:15:38.192955 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 315/608] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:37 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:38.501406 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:38.501891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:38.507708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:38.508188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:38.508935 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:38.509361 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:38.594050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lazy-loading 'services' on Instance uuid e8ef7fb3-7048-49b7-83f5-1342dcd057ef {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:15:38.663217 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-822d2dbb-eccd-45b8-90ab-b697c178ae97 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments/8fe24c76-1068-47c8-919c-5468a15f8c55" status: 202 len: 0 microversion: 2.1 time: 0.165502 Jul 18 14:15:38.663883 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 294/609] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:15:38 2022] DELETE /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments/8fe24c76-1068-47c8-919c-5468a15f8c55 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:38.672054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dc0f89ee-10f9-4a00-aad8-502c38fb9524 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:38.673132 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dc0f89ee-10f9-4a00-aad8-502c38fb9524 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:38.679481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc0f89ee-10f9-4a00-aad8-502c38fb9524 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:38.679924 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc0f89ee-10f9-4a00-aad8-502c38fb9524 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:38.680719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc0f89ee-10f9-4a00-aad8-502c38fb9524 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:38.681327 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc0f89ee-10f9-4a00-aad8-502c38fb9524 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:38.712159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dc0f89ee-10f9-4a00-aad8-502c38fb9524 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Jul 18 14:15:38.712857 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 316/610] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:38 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:39.210554 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:39.211161 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:39.218165 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:39.218604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:39.219362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:39.219895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:39.354855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:39.362379 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d31f505b-d2b5-4844-9140-16e4ec30c5d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.156651 Jul 18 14:15:39.362949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 295/611] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:39 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:39.723307 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7c088dc1-c0cc-49d7-b901-b1c8e21abcc2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:39.724303 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7c088dc1-c0cc-49d7-b901-b1c8e21abcc2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:39.730627 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c088dc1-c0cc-49d7-b901-b1c8e21abcc2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:39.731063 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c088dc1-c0cc-49d7-b901-b1c8e21abcc2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:39.732466 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c088dc1-c0cc-49d7-b901-b1c8e21abcc2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:39.732922 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7c088dc1-c0cc-49d7-b901-b1c8e21abcc2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:39.762382 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7c088dc1-c0cc-49d7-b901-b1c8e21abcc2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Jul 18 14:15:39.762949 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 317/612] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:39 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:40.379472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:40.380108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:40.386597 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.387042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.387801 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.388907 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.515282 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:40.522675 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d291a2a0-7fa8-4679-a5e2-3d44d3a96e7f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.147075 Jul 18 14:15:40.523232 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 296/613] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:40 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:40.773291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e8cadf92-d6e7-450a-8140-73eb06cca071 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:40.774211 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e8cadf92-d6e7-450a-8140-73eb06cca071 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:40.780784 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8cadf92-d6e7-450a-8140-73eb06cca071 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.781229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8cadf92-d6e7-450a-8140-73eb06cca071 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.781987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8cadf92-d6e7-450a-8140-73eb06cca071 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.782422 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e8cadf92-d6e7-450a-8140-73eb06cca071 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.811593 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e8cadf92-d6e7-450a-8140-73eb06cca071 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042477 Jul 18 14:15:40.812178 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 318/614] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:15:40 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:15:40.868850 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:40.869350 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:40.876009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.876462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.877224 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.877657 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.901434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:15:40.947757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:40.949505 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:40.956868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.957322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.958117 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:40.958571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:40.991121 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lazy-loading 'flavor' on Instance uuid c63c8795-24b6-46d9-95ae-0496378efce1 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:15:40.995904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-afdc818e-74a8-46a2-b8c4-a9b7f295f736 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 204 len: 0 microversion: 2.1 time: 0.130599 Jul 18 14:15:40.996817 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 297/615] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:15:40 2022] DELETE /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:15:41.005830 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:41.006520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:41.012484 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.012927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.013684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.014175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.102966 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e6fdf003-07c0-4d7b-b025-27d92dd597ea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "POST /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1/action" status: 202 len: 0 microversion: 2.1 time: 0.158964 Jul 18 14:15:41.103552 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 319/616] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:15:40 2022] POST /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:41.112525 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:41.113295 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:41.119460 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.119907 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.120708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.121138 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.150350 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:41.158539 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-31211fb8-34f7-4e11-96b4-35f430e78b51 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1680 microversion: 2.1 time: 0.156688 Jul 18 14:15:41.159104 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 298/617] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:41 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:41.251694 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:41.259149 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7f44d6b2-91ea-4254-b420-a1ccdceb1aea tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.150693 Jul 18 14:15:41.259702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 320/618] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:41 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:41.538495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:41.539029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:41.545872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.546307 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.547048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:41.547472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:41.676133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:41.683373 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1289fef5-a5ea-4a12-8ee4-c7bb02064561 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.148781 Jul 18 14:15:41.683924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 299/619] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:41 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:42.176388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:42.177005 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:42.183447 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.183894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.184682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.185798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.276656 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:42.277251 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:42.283116 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.283553 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.284325 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.284750 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.371765 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:42.379983 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-40de1d3d-8731-4b9e-a903-a603086153d8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1680 microversion: 2.1 time: 0.207785 Jul 18 14:15:42.380779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 321/620] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:42 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:42.478062 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:42.485934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4c035753-1102-499b-a3da-831e46a2d23d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.213091 Jul 18 14:15:42.486496 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 300/621] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:42 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:42.701149 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:42.701783 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:42.707818 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.708293 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.709055 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:42.709484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:42.914109 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:42.921565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-80d520b8-45df-48c6-b9c9-b22b4ffea7cc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.224363 Jul 18 14:15:42.922237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 322/622] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:42 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:43.286045 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c1d9101d-27c4-4d37-bc64-8ab6bd2eb03e req-14902264-00c4-4d18-b922-f990224eb7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8ef7fb3-7048-49b7-83f5-1342dcd057ef", "name": "network-vif-deleted", "tag": "78c5d199-882a-4557-82d5-faa7c5620eb9"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:43.297160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c1d9101d-27c4-4d37-bc64-8ab6bd2eb03e req-14902264-00c4-4d18-b922-f990224eb7e2 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.298538 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c1d9101d-27c4-4d37-bc64-8ab6bd2eb03e req-14902264-00c4-4d18-b922-f990224eb7e2 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.310417 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c1d9101d-27c4-4d37-bc64-8ab6bd2eb03e req-14902264-00c4-4d18-b922-f990224eb7e2 service nova] Creating event network-vif-deleted:78c5d199-882a-4557-82d5-faa7c5620eb9 for instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef on hv-cinder-84984 Jul 18 14:15:43.316055 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c1d9101d-27c4-4d37-bc64-8ab6bd2eb03e req-14902264-00c4-4d18-b922-f990224eb7e2 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033603 Jul 18 14:15:43.317012 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 301/623] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:43.397150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:43.398643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:43.406536 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.406986 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.407762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.408545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.451219 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.451971 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.453046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lazy-loading 'fault' on Instance uuid e8ef7fb3-7048-49b7-83f5-1342dcd057ef {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:15:43.501687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:43.505727 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:43.506434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:43.510915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1d2f8981-bb00-4418-ab98-65c81a2ed79c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 200 len: 1331 microversion: 2.1 time: 0.117338 Jul 18 14:15:43.515863 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 323/624] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:43 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:43.518412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.519078 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.520160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.520739 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.691557 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:43.699471 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5e23f557-737b-40bf-a641-7e00aeaff209 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.198152 Jul 18 14:15:43.700145 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 302/625] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:43 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:43.939409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:43.940181 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:43.947003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.947885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.949616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:43.950062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:43.955056 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:44.092485 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:44.100600 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a7393ea3-a7f6-4ff8-8449-0fb3786d93e1 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.165849 Jul 18 14:15:44.101184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 324/626] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:43 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:44.528346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:44.528906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:44.535270 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:44.535714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:44.536511 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:44.536968 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:44.550662 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef HTTP/1.1 Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:15:44.552300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:15:44.553824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'e8ef7fb3-7048-49b7-83f5-1342dcd057ef'} Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:15:44.554749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:15:44.556267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:15:44.557623 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:15:44.557623 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-65019db8-69c9-43c1-93ca-7304d17ca7fb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 404 len: 111 microversion: 2.1 time: 0.029330 Jul 18 14:15:44.557623 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 303/627] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:44 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:15:44.563002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8ef2eaa9-aa26-4651-8762-1525f9629d0d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '.version_select at 0x7f7b3b37d790>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:44.580448 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8ef2eaa9-aa26-4651-8762-1525f9629d0d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-751513632" status: 202 len: 0 microversion: 2.1 time: 0.021855 Jul 18 14:15:44.580988 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 325/628] 10.222.0.94 () {58 vars in 1217 bytes} [Mon Jul 18 14:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-751513632 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:44.720345 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:44.720948 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:44.726901 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:44.727346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:44.728143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:44.728572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:44.984137 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:44.991721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-39051a4a-9a98-43cf-a90b-3760ace7da78 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.275242 Jul 18 14:15:44.992318 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 304/629] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:44 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:45.117759 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:45.118367 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:45.125306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:45.125872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:45.126682 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:45.127122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:45.318921 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:45.319630 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-10771966-10d8-47aa-ae12-0367ce3197ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: .version_select at 0x7f7b400423a0>, body: {"keypair": {"name": "tempest-keypair-1664986265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz0w5RYIFRDjTewUf2/snBA927dvQgemGEpOTXXhQE4Y19FQiwUJx68/oLmUOUF9gjnJ17z48NdD4rUNpn/5J3EZGFhXvEIdQTu5fBvDwIcZG7suED5Xw8vBM62381spQ=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:45.326927 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d6d97407-cf76-4a2e-a1fb-5efbfab4ea86 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.213090 Jul 18 14:15:45.327485 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 326/630] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:45 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:45.333963 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-10771966-10d8-47aa-ae12-0367ce3197ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:15:45.337972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-10771966-10d8-47aa-ae12-0367ce3197ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:15:45.359138 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-10771966-10d8-47aa-ae12-0367ce3197ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043341 Jul 18 14:15:45.359707 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 305/631] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:15:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:15:46.010114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:46.010716 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:46.017031 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:46.017472 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:46.018243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:46.018671 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:46.243095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:46.251221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-32cd0d8a-0ab9-4959-8e1c-00e10222a1ab tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.244950 Jul 18 14:15:46.251779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 327/632] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:46 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:46.345465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:46.346075 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:46.351925 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:46.352399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:46.353159 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:46.353590 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:46.560632 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:46.569372 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-13d96a7e-3089-4f2f-8a3b-5aca94de4789 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1676 microversion: 2.1 time: 0.228633 Jul 18 14:15:46.571308 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 306/633] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:46 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:46.986399 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-855944135", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee89766c-7eb8-4f64-a3df-79441574b226"}], "security_groups": [{"name": "tempest-securitygroup--2079985115"}], "key_name": "tempest-keypair-1664986265", "user_data": "}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:47.087823 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] validate_networks() for [('ee89766c-7eb8-4f64-a3df-79441574b226', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:15:47.269589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:47.270345 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:47.276450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.276890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.277636 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.278117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.295599 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:47.489760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:47.497904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8525349e-34e3-4f0e-a050-de54e6d62b1c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.231569 Jul 18 14:15:47.498536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 307/634] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:47 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:47.570621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:15:47.571108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:15:47.571671 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:15:47.572178 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:15:47.572655 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:15:47.581628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.583246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.583246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.583996 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.588380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:47.588975 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:47.595461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.595900 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.596685 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.597120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.602546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:15:47.607781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:15:47.621109 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:15:47.624514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:15:47.672577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8bc5b30d-a230-41f7-b0c8-2128f9da24ef tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.690084 Jul 18 14:15:47.673499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 328/635] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:15:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:15:47.684168 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-17c8bd14-9f46-4556-a874-6d039579f556 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:47.685349 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-17c8bd14-9f46-4556-a874-6d039579f556 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:47.750422 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-17c8bd14-9f46-4556-a874-6d039579f556 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:47.757700 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:47.758412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-17c8bd14-9f46-4556-a874-6d039579f556 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1241 microversion: 2.1 time: 0.078550 Jul 18 14:15:47.759083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 329/636] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:47 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:47.765546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-800528f1-62f4-43b2-81d9-3ed4b92dbaff tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1653 microversion: 2.1 time: 0.180945 Jul 18 14:15:47.766119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 308/637] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:47 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1653 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:47.782128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5c2fcb4f-cc5e-46eb-80ec-146e52571cab tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:47.788186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5c2fcb4f-cc5e-46eb-80ec-146e52571cab tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.788644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5c2fcb4f-cc5e-46eb-80ec-146e52571cab tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.810891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5c2fcb4f-cc5e-46eb-80ec-146e52571cab tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Going to try to start instance {{(pid=117845) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 14:15:47.852947 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5c2fcb4f-cc5e-46eb-80ec-146e52571cab tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action" status: 202 len: 0 microversion: 2.1 time: 0.074882 Jul 18 14:15:47.853627 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 330/638] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:15:47 2022] POST /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:15:47.862726 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:47.863527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:47.870516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.871393 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:47.872525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:47.873319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:48.077928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:48.085900 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4bfb7bbe-b4ea-4f38-bfd7-32ab776e5b95 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1662 microversion: 2.1 time: 0.227519 Jul 18 14:15:48.086668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 309/639] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:47 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1662 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:48.516223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:48.516838 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:48.523188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:48.523645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:48.524439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:48.524868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:48.775360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:48.775978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:48.776243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:48.783882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:48.784581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:48.785366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e3d5f59e-ca68-4e4d-a3c1-ae15d699babb tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.274504 Jul 18 14:15:48.785568 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:48.786076 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:48.786811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 331/640] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:48 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:48.892016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:48.898874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-beb1d985-eff3-40e8-a5b8-6d0bcdbca5d0 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1311 microversion: 2.1 time: 0.127279 Jul 18 14:15:48.899435 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 310/641] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:48 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:49.103894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:49.104518 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:49.111062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:49.111506 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:49.112298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:49.112729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:49.304935 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:49.312554 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e6d6041a-c8b7-4812-9591-3e1f0efe93a0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1662 microversion: 2.1 time: 0.212476 Jul 18 14:15:49.313212 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 332/642] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:49 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1662 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:49.802900 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:49.803504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:49.810384 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:49.810836 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:49.811599 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:49.812060 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:49.915728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:49.916427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:49.918876 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:49.924184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:49.924627 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:49.925648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:49.926076 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:49.948740 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:49.956990 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fa337a8c-9f26-4cec-95ca-bef334310e25 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.158164 Jul 18 14:15:49.958177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 311/643] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:49 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:50.064719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:50.072239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7d384b6d-ef08-4cb3-bb88-3d93ec1b683d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.160275 Jul 18 14:15:50.072805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 333/644] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:49 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:50.330753 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:50.331303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:50.337382 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.337830 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.338591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.339025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.533788 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:50.542126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ee85d6ac-0253-479a-aa32-3f05b9194dc8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1666 microversion: 2.1 time: 0.215380 Jul 18 14:15:50.542990 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 312/645] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:50 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1666 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:50.806904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-b66ee686-ccc4-417e-b85c-b226ae71c214 req-e5b2b393-e862-43b6-a9f7-66e36cfb8a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52016ecd-dd32-410d-b6d1-0853b566e1e8", "tag": "0773cf1a-b729-42e7-9cdd-9186f8cda631"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:50.815736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b66ee686-ccc4-417e-b85c-b226ae71c214 req-e5b2b393-e862-43b6-a9f7-66e36cfb8a9a service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.816623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b66ee686-ccc4-417e-b85c-b226ae71c214 req-e5b2b393-e862-43b6-a9f7-66e36cfb8a9a service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.830503 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-b66ee686-ccc4-417e-b85c-b226ae71c214 req-e5b2b393-e862-43b6-a9f7-66e36cfb8a9a service nova] Creating event network-changed:0773cf1a-b729-42e7-9cdd-9186f8cda631 for instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 on hv-cinder-84984 Jul 18 14:15:50.835719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-b66ee686-ccc4-417e-b85c-b226ae71c214 req-e5b2b393-e862-43b6-a9f7-66e36cfb8a9a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032959 Jul 18 14:15:50.836305 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 334/646] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:50.974767 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:50.975374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:50.981938 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.982384 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:50.983146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:50.983575 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:51.091362 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:51.092102 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:51.098252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:51.098685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:51.099440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:51.099859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:51.247439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:51.254961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9fa17221-f25c-4d26-ae96-ad79152684ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.284056 Jul 18 14:15:51.255723 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 313/647] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:50 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:51.341482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:51.348817 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fa3a48fe-1683-404f-a20c-bfd97b4a78f9 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.262584 Jul 18 14:15:51.349375 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 335/648] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:51 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:52.272553 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:52.273088 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:52.280469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:52.280914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:52.281669 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:52.282100 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:52.366169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:52.366900 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:52.372936 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:52.373374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:52.374127 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:52.374551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:52.425008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:52.432620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-43ce23b7-e30d-4173-9fc5-15fd227deb6e tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.163931 Jul 18 14:15:52.433278 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 314/649] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:52 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:52.508527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:52.515757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2032fad6-ce0e-4ba1-8657-d12f23097e84 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.153993 Jul 18 14:15:52.516346 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 336/650] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:52 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:53.449335 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:53.450495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:53.456891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:53.457327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:53.458076 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:53.458524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:53.532981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:53.534248 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:53.540197 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:53.540644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:53.541498 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:53.541847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:53.599242 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:53.606674 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-10131960-c6a1-4859-942d-5b82f01f270b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.161332 Jul 18 14:15:53.607466 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 315/651] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:53 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:53.679053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:53.686456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6b414c3f-6a25-4c2c-9f28-9adc3c4a6109 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.157323 Jul 18 14:15:53.687082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 337/652] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:53 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:54.624060 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:54.624687 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:54.631355 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:54.631801 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:54.632686 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:54.633235 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:54.702992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:54.703925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:54.710767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:54.711453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:54.712410 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:54.712907 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:55.024973 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:55.032768 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9e5d71c3-c97b-4dce-a6a7-a1c9ab44a378 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.412714 Jul 18 14:15:55.033442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 316/653] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:54 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:55.124386 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:55.132376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-681649e9-57a4-4faa-b30e-450a38f84541 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.433526 Jul 18 14:15:55.133116 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 338/654] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:54 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:56.050261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:56.050871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:56.052788 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:56.053960 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:56.061325 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:56.061844 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:56.062610 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:56.063046 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:56.149286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:56.149945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:56.156521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:56.156966 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:56.157737 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:56.158167 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:56.207814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:56.215600 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-899d1e07-918c-43dd-9c0d-9e0bd0a212ad tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.169414 Jul 18 14:15:56.216199 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 317/655] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:56 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:56.295545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:56.303274 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8609d921-164a-46d9-937c-2cc296461802 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.157748 Jul 18 14:15:56.303844 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 339/656] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:56 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:57.233300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:57.233843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:57.240415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:57.240865 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:57.241634 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:57.242068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:57.321039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:57.321805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:57.328633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:57.329168 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:57.330158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:57.330927 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:57.391796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:57.399281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2963550d-f915-449c-ae42-190165897a59 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.170348 Jul 18 14:15:57.408961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 318/657] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:57 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:57.492724 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:57.500749 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cb9b243b-6f78-4fba-9f5b-849fbe02e0b1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.183606 Jul 18 14:15:57.501310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 340/658] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:57 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:58.415513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:58.416159 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:58.423298 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.423744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.424804 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.425235 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.517919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:58.518532 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:58.520509 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:58.521346 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=8 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:58.529279 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.529729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.530500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.530935 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.553188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:58.560826 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9110c510-fe44-41f9-a4c1-7f3c5be09901 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1511 microversion: 2.1 time: 0.149143 Jul 18 14:15:58.568304 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 319/659] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:58 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:58.576994 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fc30c5ac-d079-4b99-a769-34529056060a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:58.577554 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fc30c5ac-d079-4b99-a769-34529056060a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:58.583548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc30c5ac-d079-4b99-a769-34529056060a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.584015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc30c5ac-d079-4b99-a769-34529056060a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.584781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc30c5ac-d079-4b99-a769-34529056060a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.585203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fc30c5ac-d079-4b99-a769-34529056060a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.667657 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:58.673032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fc30c5ac-d079-4b99-a769-34529056060a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "POST /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1/action" status: 202 len: 0 microversion: 2.1 time: 0.099827 Jul 18 14:15:58.673853 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 320/660] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:15:58 2022] POST /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:15:58.675574 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-043f5f61-9e1c-44eb-a43f-cfaddb5c0ae3 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.161411 Jul 18 14:15:58.676306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 341/661] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:58 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:58.685095 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:58.685725 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:58.691895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.692374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.693137 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.693570 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.833155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:58.842984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-25cdbb5f-2363-4bb3-9b70-9288ac63a13f tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1519 microversion: 2.1 time: 0.161262 Jul 18 14:15:58.844708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 321/662] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:58 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:15:58.893255 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-e4aa4649-e38d-45b7-a44f-405e71c697b8 req-0b31dd8e-b44f-4521-b390-f7422a006c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52016ecd-dd32-410d-b6d1-0853b566e1e8", "name": "network-vif-plugged", "status": "completed", "tag": "0773cf1a-b729-42e7-9cdd-9186f8cda631"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:15:58.901968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-e4aa4649-e38d-45b7-a44f-405e71c697b8 req-0b31dd8e-b44f-4521-b390-f7422a006c8e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:58.903044 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-e4aa4649-e38d-45b7-a44f-405e71c697b8 req-0b31dd8e-b44f-4521-b390-f7422a006c8e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:58.915872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-e4aa4649-e38d-45b7-a44f-405e71c697b8 req-0b31dd8e-b44f-4521-b390-f7422a006c8e service nova] Creating event network-vif-plugged:0773cf1a-b729-42e7-9cdd-9186f8cda631 for instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 on hv-cinder-84984 Jul 18 14:15:58.921058 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-e4aa4649-e38d-45b7-a44f-405e71c697b8 req-0b31dd8e-b44f-4521-b390-f7422a006c8e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031624 Jul 18 14:15:58.921887 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 342/663] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:15:59.692351 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:59.693065 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:59.700654 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:59.701100 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:59.701881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:59.702415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:59.835298 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:15:59.843083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-81aac02b-52e5-4e3a-837a-594bf62d903b tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1367 microversion: 2.1 time: 0.154559 Jul 18 14:15:59.843643 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 322/664] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:59 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:15:59.861324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:15:59.862008 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:15:59.868081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:59.868526 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:59.869277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:15:59.869701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:15:59.998868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:00.001193 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:00.007797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4cca496d-f05d-4f41-9644-106e4c378be3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1521 microversion: 2.1 time: 0.150937 Jul 18 14:16:00.008365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 343/665] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:15:59 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:00.859832 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:00.860426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:00.866705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:00.867147 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:00.867901 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:00.868358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:00.872683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:00.954833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-2ee14f79-5056-41b5-ae30-5f6157483ca9 req-bea2247e-4bc1-4127-8912-ccf7e96723ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c8795-24b6-46d9-95ae-0496378efce1", "name": "network-vif-unplugged", "status": "completed", "tag": "a158e474-2cc0-48e6-9c01-f790a2f7a2a3"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:00.964511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-2ee14f79-5056-41b5-ae30-5f6157483ca9 req-bea2247e-4bc1-4127-8912-ccf7e96723ab service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:00.964956 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-2ee14f79-5056-41b5-ae30-5f6157483ca9 req-bea2247e-4bc1-4127-8912-ccf7e96723ab service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:00.976845 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.compute.server_external_events [req-2ee14f79-5056-41b5-ae30-5f6157483ca9 req-bea2247e-4bc1-4127-8912-ccf7e96723ab service nova] Unable to find a host for instance c63c8795-24b6-46d9-95ae-0496378efce1. Dropping event network-vif-unplugged {{(pid=117845) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 14:16:00.977719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-2ee14f79-5056-41b5-ae30-5f6157483ca9 req-bea2247e-4bc1-4127-8912-ccf7e96723ab service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027186 Jul 18 14:16:00.978295 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 344/666] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 14:16:01.006066 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:01.013513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-88396680-dff5-4581-9bcd-85d3c30d2ab2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1555 microversion: 2.1 time: 0.157524 Jul 18 14:16:01.014094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 323/667] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:00 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:01.025019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:01.025629 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:01.029046 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-28b4423a-b76b-4426-b2fa-af67fd6aa2c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:01.029532 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-28b4423a-b76b-4426-b2fa-af67fd6aa2c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:01.031834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:01.032534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:01.033302 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:01.033733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:01.035208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28b4423a-b76b-4426-b2fa-af67fd6aa2c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:01.035651 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28b4423a-b76b-4426-b2fa-af67fd6aa2c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:01.036460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28b4423a-b76b-4426-b2fa-af67fd6aa2c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:01.036895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-28b4423a-b76b-4426-b2fa-af67fd6aa2c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:01.149993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-28b4423a-b76b-4426-b2fa-af67fd6aa2c8 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124450 Jul 18 14:16:01.150583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 324/668] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:16:01 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:16:01.197075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:01.212598 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0b1f91c8-396c-4e66-9816-0b0ad0cf2245 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1521 microversion: 2.1 time: 0.189610 Jul 18 14:16:01.213229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 345/669] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:01 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:02.230380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:02.231749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:02.239030 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:02.239482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:02.240352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:02.240732 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:02.310828 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-b3028536-7945-449d-a69d-e734426b2c44 req-121b36e7-c464-4622-816e-10c952d79614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52016ecd-dd32-410d-b6d1-0853b566e1e8", "tag": "0773cf1a-b729-42e7-9cdd-9186f8cda631"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:02.321207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b3028536-7945-449d-a69d-e734426b2c44 req-121b36e7-c464-4622-816e-10c952d79614 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:02.321780 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b3028536-7945-449d-a69d-e734426b2c44 req-121b36e7-c464-4622-816e-10c952d79614 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:02.334011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-b3028536-7945-449d-a69d-e734426b2c44 req-121b36e7-c464-4622-816e-10c952d79614 service nova] Creating event network-changed:0773cf1a-b729-42e7-9cdd-9186f8cda631 for instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 on hv-cinder-84984 Jul 18 14:16:02.340355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-b3028536-7945-449d-a69d-e734426b2c44 req-121b36e7-c464-4622-816e-10c952d79614 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034020 Jul 18 14:16:02.341068 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 346/670] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:16:02.446124 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:02.453944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ee75f4f4-3e1a-4af3-af2d-8d376fd6177c tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.228124 Jul 18 14:16:02.454654 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 325/671] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:02 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:03.473780 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:03.474508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:03.480658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:03.481101 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:03.481869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:03.482295 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:03.609512 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:03.616896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a180d6ab-27ac-4912-a6e5-c06eb6f898d0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.147756 Jul 18 14:16:03.617486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 347/672] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:03 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:04.634240 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:04.634838 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:04.641525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:04.641958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:04.642698 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:04.643120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:04.773694 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:04.781733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f7cad7ae-b6f3-4159-a3de-31c198205f77 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.151261 Jul 18 14:16:04.782290 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 326/673] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:04 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:05.798705 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:05.799594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:05.806022 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:05.806463 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:05.807216 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:05.807644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:05.941453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:05.949474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4a1da114-a878-4ca9-926c-035d0b5472fe tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.154207 Jul 18 14:16:05.949790 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 348/674] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:05 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:06.966684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:06.967299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:06.973747 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:06.974195 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:06.974956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:06.975388 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:07.105758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:07.113083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e41e7941-d13a-4b17-8fc5-e9f23cec46f3 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.150447 Jul 18 14:16:07.113642 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 327/675] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:06 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:16:08.130542 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:08.131140 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:08.138220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:08.138658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:08.139406 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:08.139833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:08.267001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:08.274494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-55cbbf8c-a94e-4082-9675-e6937256b3b2 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.147743 Jul 18 14:16:08.275056 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 349/676] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:08 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:09.293739 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:09.294359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:09.301627 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:09.302078 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:09.302846 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:09.303282 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:09.439905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:09.447343 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6ddac811-d87a-4bf1-8289-51a7828ba1b0 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.159046 Jul 18 14:16:09.447911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 328/677] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:09 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:10.559427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:10.560065 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:10.565949 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:10.566396 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:10.567158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:10.567589 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:10.702629 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:10.712172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f0e394fa-69f9-4502-a827-704bd5757a10 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.251854 Jul 18 14:16:10.712759 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 350/678] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:10 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:11.730645 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:11.731245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:11.738096 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:11.738555 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:11.739440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:11.739991 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:11.883128 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:11.890513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-51fefa38-c61e-4475-81d6-7362587cc5a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.164315 Jul 18 14:16:11.891073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 329/679] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:11 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:12.906602 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:12.907208 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:12.913681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:12.914121 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:12.914889 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:12.915317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:13.047755 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:13.055428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b50e9c62-48a7-4de4-9d95-6cc7605e5675 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.152770 Jul 18 14:16:13.056006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 351/680] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:12 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:14.073023 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:14.073628 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:14.080015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:14.080457 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:14.081207 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:14.081631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:14.209557 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:14.217532 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6b727115-6510-4207-b86a-8721cd97ae23 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.148412 Jul 18 14:16:14.218083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 330/681] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:14 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:14.878527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-929d7d94-0d45-4f1a-8ff0-14de6a7adc5c req-df70b5d6-029d-44c3-be69-fd54e54e5f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c8795-24b6-46d9-95ae-0496378efce1", "name": "network-vif-plugged", "status": "completed", "tag": "a158e474-2cc0-48e6-9c01-f790a2f7a2a3"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:14.888164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-929d7d94-0d45-4f1a-8ff0-14de6a7adc5c req-df70b5d6-029d-44c3-be69-fd54e54e5f51 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:14.888606 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-929d7d94-0d45-4f1a-8ff0-14de6a7adc5c req-df70b5d6-029d-44c3-be69-fd54e54e5f51 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:14.900157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-929d7d94-0d45-4f1a-8ff0-14de6a7adc5c req-df70b5d6-029d-44c3-be69-fd54e54e5f51 service nova] Creating event network-vif-plugged:a158e474-2cc0-48e6-9c01-f790a2f7a2a3 for instance c63c8795-24b6-46d9-95ae-0496378efce1 on hv-cinder-84984 Jul 18 14:16:14.910103 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-929d7d94-0d45-4f1a-8ff0-14de6a7adc5c req-df70b5d6-029d-44c3-be69-fd54e54e5f51 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035139 Jul 18 14:16:14.910885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 352/682] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:15.234794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:15.235401 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:15.241560 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:15.242002 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:15.242757 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:15.243189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:15.369451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:15.377629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-587e160d-5347-45e1-83a9-52870f2e1463 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.146641 Jul 18 14:16:15.378200 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 331/683] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:15 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:16.395761 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:16.396474 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:16.403221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:16.403662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:16.404515 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:16.404941 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:16.534602 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:16.542670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cfade4d3-33ba-47b4-ad3b-0611201e666b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1577 microversion: 2.1 time: 0.151056 Jul 18 14:16:16.543328 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 353/684] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:16 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:17.560020 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:17.560651 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:17.566844 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:17.567287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:17.568080 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:17.568509 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:17.699137 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:17.706535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-80e6c910-283b-40e4-b4b8-76393afad96a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1564 microversion: 2.1 time: 0.150442 Jul 18 14:16:17.707099 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 332/685] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:17 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:21.696054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:21.696548 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:21.699050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=42 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:21.705001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:21.705443 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:21.706241 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:21.706669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:21.973407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lazy-loading 'services' on Instance uuid cfcc3bf9-291d-4700-bd55-f2116a5be826 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:16:22.085023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9c4c87cd-36c6-408d-92a8-ddf4a27aa329 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "DELETE /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments/3bbe4ea0-06a2-4f1b-a4e1-df7364b44b72" status: 202 len: 0 microversion: 2.1 time: 0.392824 Jul 18 14:16:22.085623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 354/686] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:16:21 2022] DELETE /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments/3bbe4ea0-06a2-4f1b-a4e1-df7364b44b72 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:16:22.094707 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-56cc6991-3b43-4ca4-b601-75b0aa32d442 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:22.095691 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-56cc6991-3b43-4ca4-b601-75b0aa32d442 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:22.102364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56cc6991-3b43-4ca4-b601-75b0aa32d442 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:22.102816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56cc6991-3b43-4ca4-b601-75b0aa32d442 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:22.103577 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56cc6991-3b43-4ca4-b601-75b0aa32d442 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:22.104094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-56cc6991-3b43-4ca4-b601-75b0aa32d442 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:22.139906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-56cc6991-3b43-4ca4-b601-75b0aa32d442 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Jul 18 14:16:22.140922 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 333/687] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:16:22 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:23.154039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-de7fc291-4f61-46ce-8b43-dfb53bfe04f9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:23.155095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-de7fc291-4f61-46ce-8b43-dfb53bfe04f9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:23.161362 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de7fc291-4f61-46ce-8b43-dfb53bfe04f9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:23.161798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de7fc291-4f61-46ce-8b43-dfb53bfe04f9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:23.162545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de7fc291-4f61-46ce-8b43-dfb53bfe04f9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:23.162967 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de7fc291-4f61-46ce-8b43-dfb53bfe04f9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:23.193468 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-de7fc291-4f61-46ce-8b43-dfb53bfe04f9 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Jul 18 14:16:23.194020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 355/688] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:16:23 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:24.205320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c12dc4a5-285f-4786-a03a-13e550392cf0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:24.206196 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c12dc4a5-285f-4786-a03a-13e550392cf0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:24.212650 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c12dc4a5-285f-4786-a03a-13e550392cf0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:24.213095 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c12dc4a5-285f-4786-a03a-13e550392cf0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:24.213855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c12dc4a5-285f-4786-a03a-13e550392cf0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:24.214356 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c12dc4a5-285f-4786-a03a-13e550392cf0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:24.243394 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c12dc4a5-285f-4786-a03a-13e550392cf0 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042141 Jul 18 14:16:24.243955 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 334/689] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:16:24 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:16:24.321146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:24.321678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:24.328162 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:24.328612 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:24.329372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:24.329799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:24.354357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Going to try to terminate instance {{(pid=117845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:16:24.426402 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a831e953-70f4-4a1c-ab97-883db2279cef tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "DELETE /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 204 len: 0 microversion: 2.1 time: 0.110537 Jul 18 14:16:24.426975 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 356/690] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:16:24 2022] DELETE /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:16:24.435215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:24.435820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:24.441727 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:24.442168 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:24.442914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:24.443337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:24.571171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:24.579182 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b9616341-f7be-4c37-b770-8ffd0e64ba61 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1688 microversion: 2.1 time: 0.148036 Jul 18 14:16:24.579740 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 335/691] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:24 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:25.597073 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:25.597762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:25.604209 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:25.604653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:25.605459 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:25.605896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:25.733715 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:25.741116 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e877bcab-6f70-4440-9e8f-e7725ffdfce1 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1688 microversion: 2.1 time: 0.148256 Jul 18 14:16:25.741668 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 357/692] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:25 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:26.758736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:26.759316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:26.761724 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=40 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:26.767040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:26.767477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:26.768245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:26.768669 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:26.893631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:26.900982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fb83138f-60e3-43b2-80cc-1ac064c93a74 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1688 microversion: 2.1 time: 0.146115 Jul 18 14:16:26.901535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 336/693] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:26 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:27.918814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:27.919525 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:27.926310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:27.926754 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:27.927512 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:27.927964 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:28.071659 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:28.079045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6427dda6-1570-4adb-b46e-c5ccd1a07eb6 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1688 microversion: 2.1 time: 0.164534 Jul 18 14:16:28.079605 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 358/694] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:27 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:29.096202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:29.096808 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:29.103262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:29.103705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:29.104484 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:29.104911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:29.306363 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:29.314471 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-021d30b0-f3d2-410d-8cd9-7acac63358ed tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 200 len: 1688 microversion: 2.1 time: 0.222203 Jul 18 14:16:29.315049 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 337/695] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:29 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:29.734084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-71194133-2c39-4a81-aebc-1b0371f67cbf req-5672e62e-6c2e-4fdf-9c6f-297d7b8e929f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfcc3bf9-291d-4700-bd55-f2116a5be826", "name": "network-vif-deleted", "tag": "b727dd55-3851-43a8-95d2-3c1008ebee22"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:29.743181 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-71194133-2c39-4a81-aebc-1b0371f67cbf req-5672e62e-6c2e-4fdf-9c6f-297d7b8e929f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:29.743628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-71194133-2c39-4a81-aebc-1b0371f67cbf req-5672e62e-6c2e-4fdf-9c6f-297d7b8e929f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:29.755280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-71194133-2c39-4a81-aebc-1b0371f67cbf req-5672e62e-6c2e-4fdf-9c6f-297d7b8e929f service nova] Creating event network-vif-deleted:b727dd55-3851-43a8-95d2-3c1008ebee22 for instance cfcc3bf9-291d-4700-bd55-f2116a5be826 on hv-cinder-84984 Jul 18 14:16:29.760108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-71194133-2c39-4a81-aebc-1b0371f67cbf req-5672e62e-6c2e-4fdf-9c6f-297d7b8e929f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030075 Jul 18 14:16:29.760828 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 359/696] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:30.332622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:30.334053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: cfcc3bf9-291d-4700-bd55-f2116a5be826] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:30.342606 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:30.343424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:30.344501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:30.344947 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:30.358814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] HTTP exception thrown: Instance cfcc3bf9-291d-4700-bd55-f2116a5be826 could not be found. Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Request method failure captured: Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 HTTP/1.1 Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wlqlb5vVhBtiN9LYhex0arcXaQaWB9pkT7ZYEGOQJ-C985AGyoC8hBJzCJ66LDgRu4P1-0_9agqg5KTCCRlUoseBHZGSGYgbe1f2ZGQSvpU9y18Rpook9YYagQtQhqVlGNL2-bPawldUfT9JkIv0i4AqmdfFsqImUsVaNGlQxCVvSU Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:16:30.360370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_eaf9f75abc034491bd1b8846c05bf625"}]}] Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 3720c2225b51464abee34d05a69b9db7 Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance cfcc3bf9-291d-4700-bd55-f2116a5be826 could not be found. Jul 18 14:16:30.362050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'cfcc3bf9-291d-4700-bd55-f2116a5be826'} Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfcc3bf9-291d-4700-bd55-f2116a5be826 could not be found. Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:16:30.363276 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfcc3bf9-291d-4700-bd55-f2116a5be826 could not be found. Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfcc3bf9-291d-4700-bd55-f2116a5be826 could not be found. Jul 18 14:16:30.365013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:30.367476 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Returning 404 to user: Instance cfcc3bf9-291d-4700-bd55-f2116a5be826 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:16:30.367476 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cbda4a64-2fdc-454c-83b1-010f12128c63 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826" status: 404 len: 111 microversion: 2.1 time: 0.034051 Jul 18 14:16:30.367476 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 338/697] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:30 2022] GET /compute/v2.1/servers/cfcc3bf9-291d-4700-bd55-f2116a5be826 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:16:30.371058 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0db26f3f-aeed-4921-936d-27d3f7c3c3ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '.version_select at 0x7f7b3b337c10>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:30.389179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0db26f3f-aeed-4921-936d-27d3f7c3c3ee tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019366119" status: 202 len: 0 microversion: 2.1 time: 0.022107 Jul 18 14:16:30.390280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 360/698] 10.222.0.94 () {58 vars in 1220 bytes} [Mon Jul 18 14:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019366119 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:16:33.380255 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:33.380750 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:33.387809 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:33.389046 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:33.389849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:33.390292 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:33.394440 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=89 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:33.415844 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:16:33.489416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-43d524c2-9f4b-4c2a-8d52-18b1d62bc956 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 204 len: 0 microversion: 2.1 time: 0.112702 Jul 18 14:16:33.489980 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 339/699] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:16:33 2022] DELETE /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:16:33.499262 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:33.500028 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:33.506578 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:33.507135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:33.507913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:33.508376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:33.513737 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:33.648731 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:33.656000 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e17c92a4-1194-4c06-8e55-73209d268d81 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1507 microversion: 2.1 time: 0.161912 Jul 18 14:16:33.656557 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 361/700] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:33 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:16:34.674252 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:34.675011 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:34.681471 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:34.681919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:34.682688 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:34.683125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:34.992216 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:35.000006 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d0137098-7f49-459e-9d27-5d45a8baac32 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1507 microversion: 2.1 time: 0.330235 Jul 18 14:16:35.000569 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 340/701] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:34 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:35.447217 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-4f1e88d8-55be-40d3-aa7f-ccada9bb44cd req-38729665-3cdf-44ee-b50c-396a1b7566a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b465817c-08b2-4f29-a439-143ad9d67561", "name": "network-vif-deleted", "tag": "242eaddb-7d26-4618-bcb7-2932b894ee02"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:35.460051 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-4f1e88d8-55be-40d3-aa7f-ccada9bb44cd req-38729665-3cdf-44ee-b50c-396a1b7566a7 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:35.461020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-4f1e88d8-55be-40d3-aa7f-ccada9bb44cd req-38729665-3cdf-44ee-b50c-396a1b7566a7 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:35.476288 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-4f1e88d8-55be-40d3-aa7f-ccada9bb44cd req-38729665-3cdf-44ee-b50c-396a1b7566a7 service nova] Creating event network-vif-deleted:242eaddb-7d26-4618-bcb7-2932b894ee02 for instance b465817c-08b2-4f29-a439-143ad9d67561 on hv-cinder-84984 Jul 18 14:16:35.483171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-4f1e88d8-55be-40d3-aa7f-ccada9bb44cd req-38729665-3cdf-44ee-b50c-396a1b7566a7 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039708 Jul 18 14:16:35.484412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 362/702] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:36.017966 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:36.018523 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:36.025168 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:36.025596 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:36.026387 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:36.026818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:36.057621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:36.058059 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:36.059142 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lazy-loading 'fault' on Instance uuid b465817c-08b2-4f29-a439-143ad9d67561 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:16:36.106264 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:36.112981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bf5db285-302c-4e3d-aeb9-ea32902976de tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 200 len: 1312 microversion: 2.1 time: 0.099319 Jul 18 14:16:36.113538 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 341/703] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:36 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:37.130924 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:37.131623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: b465817c-08b2-4f29-a439-143ad9d67561] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:37.137915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.138394 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.139160 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.139588 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.152618 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] HTTP exception thrown: Instance b465817c-08b2-4f29-a439-143ad9d67561 could not be found. Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Request method failure captured: Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 HTTP/1.1 Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wlqlb5vVhBtiN9LYhex0arcXaQaWB9pkT7ZYEGOQJ-C985AGyoC8hBJzCJ66LDgRu4P1-0_9agqg5KTCCRlUoseBHZGSGYgbe1f2ZGQSvpU9y18Rpook9YYagQtQhqVlGNL2-bPawldUfT9JkIv0i4AqmdfFsqImUsVaNGlQxCVvSU Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:16:37.154207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_eaf9f75abc034491bd1b8846c05bf625"}]}] Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 3720c2225b51464abee34d05a69b9db7 Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance b465817c-08b2-4f29-a439-143ad9d67561 could not be found. Jul 18 14:16:37.155776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'b465817c-08b2-4f29-a439-143ad9d67561'} Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b465817c-08b2-4f29-a439-143ad9d67561 could not be found. Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:16:37.156663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b465817c-08b2-4f29-a439-143ad9d67561 could not be found. Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b465817c-08b2-4f29-a439-143ad9d67561 could not be found. Jul 18 14:16:37.157908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:16:37.159062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Returning 404 to user: Instance b465817c-08b2-4f29-a439-143ad9d67561 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:16:37.159062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-78a010f5-308d-47bc-8343-dbee0bd3300a tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561" status: 404 len: 111 microversion: 2.1 time: 0.029595 Jul 18 14:16:37.159062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 363/704] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:37 2022] GET /compute/v2.1/servers/b465817c-08b2-4f29-a439-143ad9d67561 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:16:37.164022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:37.164546 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:37.171458 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.171902 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.172956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.173382 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.199109 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:16:37.272032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e71654d1-e60a-4b47-b09a-c1f365f74623 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 204 len: 0 microversion: 2.1 time: 0.111530 Jul 18 14:16:37.272609 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 342/705] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:16:37 2022] DELETE /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:16:37.281771 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:37.282381 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:37.288409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.288854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.289617 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:37.290047 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:37.423695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:37.431156 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-898a8292-ed3d-44f2-a286-9242e3605771 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.153990 Jul 18 14:16:37.431717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 364/706] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:37 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:38.449583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:38.450354 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:38.457558 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:38.458004 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:38.458764 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:38.459225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:38.676696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3720c2225b51464abee34d05a69b9db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaf9f75abc034491bd1b8846c05bf625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:38.686152 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3890fa98-b6b8-4070-9699-510e229da141 tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 200 len: 1520 microversion: 2.1 time: 0.241410 Jul 18 14:16:38.687220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 343/707] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:38 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:38.712061 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-52e3a070-a1cd-4d53-a60d-44bd5996b23d req-07164189-61c1-49dc-9a96-1a4f3ac55683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e87ba3d-6fdc-4f00-872f-10529eae1db5", "name": "network-vif-deleted", "tag": "caff2315-38e2-45b5-bb40-99b2083aaf3a"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:38.721976 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-52e3a070-a1cd-4d53-a60d-44bd5996b23d req-07164189-61c1-49dc-9a96-1a4f3ac55683 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:38.722453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-52e3a070-a1cd-4d53-a60d-44bd5996b23d req-07164189-61c1-49dc-9a96-1a4f3ac55683 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:38.734249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-52e3a070-a1cd-4d53-a60d-44bd5996b23d req-07164189-61c1-49dc-9a96-1a4f3ac55683 service nova] Creating event network-vif-deleted:caff2315-38e2-45b5-bb40-99b2083aaf3a for instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 on hv-cinder-84984 Jul 18 14:16:38.740038 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-52e3a070-a1cd-4d53-a60d-44bd5996b23d req-07164189-61c1-49dc-9a96-1a4f3ac55683 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 Jul 18 14:16:38.740640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 365/708] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:16:39.704066 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:39.704677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] [instance: 6e87ba3d-6fdc-4f00-872f-10529eae1db5] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:39.711347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:39.711789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:39.712596 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:39.713025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:39.726172 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] HTTP exception thrown: Instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 could not be found. Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Request method failure captured: Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 HTTP/1.1 Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wlqlb5vVhBtiN9LYhex0arcXaQaWB9pkT7ZYEGOQJ-C985AGyoC8hBJzCJ66LDgRu4P1-0_9agqg5KTCCRlUoseBHZGSGYgbe1f2ZGQSvpU9y18Rpook9YYagQtQhqVlGNL2-bPawldUfT9JkIv0i4AqmdfFsqImUsVaNGlQxCVvSU Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:16:39.727702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/eaf9f75abc034491bd1b8846c05bf625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_eaf9f75abc034491bd1b8846c05bf625"}]}] Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: eaf9f75abc034491bd1b8846c05bf625 Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-177133946 Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 3720c2225b51464abee34d05a69b9db7 Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-ServerRescueNegativeTestJSON-177133946-project Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 could not be found. Jul 18 14:16:39.729185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '6e87ba3d-6fdc-4f00-872f-10529eae1db5'} Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 could not be found. Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:16:39.729977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 could not be found. Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 could not be found. Jul 18 14:16:39.731410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:16:39.732803 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] Returning 404 to user: Instance 6e87ba3d-6fdc-4f00-872f-10529eae1db5 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:16:39.732803 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6127ee48-ea20-4580-950c-1f931e4293bd tempest-ServerRescueNegativeTestJSON-177133946 tempest-ServerRescueNegativeTestJSON-177133946-project] 10.222.0.94 "GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5" status: 404 len: 111 microversion: 2.1 time: 0.028967 Jul 18 14:16:39.732803 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 344/709] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:39 2022] GET /compute/v2.1/servers/6e87ba3d-6fdc-4f00-872f-10529eae1db5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:16:48.721414 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:48.727151 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=17 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:48.735105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9be69f56-ef6f-4332-8df6-ae5c09e69afd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'create', calling method: .version_select at 0x7f7b3b3e1ca0>, body: {"keypair": {"name": "tempest-keypair-1853498577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0hl9heHGS5DlTEPHXj1gIVD4nizFh8zLL0e2bQmzOxtoMGDC0csirRPT8EBrBBw1LtX97h2u5QlqWAQHl5sARD6A/96Rf6KNCvVyQC55MbnMnPtyjnEueLvH1Yt0tcLA=="}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:48.751095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-9be69f56-ef6f-4332-8df6-ae5c09e69afd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:16:48.755486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-9be69f56-ef6f-4332-8df6-ae5c09e69afd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for user 8561df96cd7c47c89d283e36fc637bb0 and project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:16:48.779408 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9be69f56-ef6f-4332-8df6-ae5c09e69afd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.215064 Jul 18 14:16:48.780141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 366/710] 10.222.0.94 () {62 vars in 1199 bytes} [Mon Jul 18 14:16:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 217 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 14:16:50.092355 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1454672905", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20020f83-2428-4bfd-81fa-0f1a764c36bd"}], "security_groups": [{"name": "tempest-securitygroup--149135489"}], "key_name": "tempest-keypair-1853498577", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:50.100883 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:50.101539 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:50.202607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] validate_networks() for [('20020f83-2428-4bfd-81fa-0f1a764c36bd', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:16:50.576097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:16:50.576521 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:16:50.576998 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:16:50.577403 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:16:50.578029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:16:50.586856 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:50.587306 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:50.588155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:50.588591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:50.606789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:16:50.610775 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for user 8561df96cd7c47c89d283e36fc637bb0 and project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:16:50.623746 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:16:50.626206 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:16:50.675814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e8da9d4f-d650-447b-8e0c-235a6f6a1373 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.588030 Jul 18 14:16:50.676754 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 345/711] 10.222.0.94 () {62 vars in 1187 bytes} [Mon Jul 18 14:16:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 14:16:50.687477 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4e390690-1f08-4258-9d18-94b2f0cd257d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:50.688226 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4e390690-1f08-4258-9d18-94b2f0cd257d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:50.748332 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e390690-1f08-4258-9d18-94b2f0cd257d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:50.756754 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e390690-1f08-4258-9d18-94b2f0cd257d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:50.758436 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e390690-1f08-4258-9d18-94b2f0cd257d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:50.759646 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4e390690-1f08-4258-9d18-94b2f0cd257d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1282 microversion: 2.20 time: 0.076499 Jul 18 14:16:50.760321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 367/712] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:50 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:16:51.778457 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:51.779849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:51.786635 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:51.791058 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:51.792034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:51.792485 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:51.868414 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:51.878547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:51.880298 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:51.881933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ca7b0324-b6f5-4931-8766-040f138d3dea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1334 microversion: 2.20 time: 0.108661 Jul 18 14:16:51.884304 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 346/713] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:51 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1334 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:16:52.902222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:52.902911 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:52.910077 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:52.910519 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:52.911484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:52.911915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:53.129001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:53.138675 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:53.139261 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:53.140509 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-03013b9b-653e-422e-9a80-375990b2b980 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1407 microversion: 2.20 time: 0.242184 Jul 18 14:16:53.141494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 368/714] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:52 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:16:53.654119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-fd884a98-596c-42e4-ad85-8b42d8dfd0ee req-4ccc71cc-4808-4322-bfec-bd915e2d311c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4858912-7c34-49ae-ad4b-ed96c3ca704a", "tag": "d2e80dca-1817-42f8-9092-05e8705d1f77"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:53.667588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-fd884a98-596c-42e4-ad85-8b42d8dfd0ee req-4ccc71cc-4808-4322-bfec-bd915e2d311c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:53.668296 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-fd884a98-596c-42e4-ad85-8b42d8dfd0ee req-4ccc71cc-4808-4322-bfec-bd915e2d311c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:53.682915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-fd884a98-596c-42e4-ad85-8b42d8dfd0ee req-4ccc71cc-4808-4322-bfec-bd915e2d311c service nova] Creating event network-changed:d2e80dca-1817-42f8-9092-05e8705d1f77 for instance c4858912-7c34-49ae-ad4b-ed96c3ca704a on hv-cinder-84984 Jul 18 14:16:53.690111 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-fd884a98-596c-42e4-ad85-8b42d8dfd0ee req-4ccc71cc-4808-4322-bfec-bd915e2d311c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039992 Jul 18 14:16:53.691828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 347/715] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:54.159415 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:54.160043 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:54.170004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:54.170458 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:54.172265 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:54.172608 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:54.305392 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:54.313995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:54.315502 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:54.316636 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6048af21-b6f3-494d-abc2-ee4b141897bd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1407 microversion: 2.20 time: 0.161136 Jul 18 14:16:54.317189 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 369/716] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:54 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:16:55.334661 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:55.335352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:55.342156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:55.342597 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:55.343344 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:55.343772 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:55.469336 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:55.477284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:55.478793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:55.480327 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d9ca3beb-74f0-403f-8eac-e71340b28c31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1407 microversion: 2.20 time: 0.149432 Jul 18 14:16:55.481233 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 348/717] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:55 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:16:56.498651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:56.499513 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:56.506874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:56.507781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:56.508714 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:56.509151 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:56.704451 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:56.713658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:56.715171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:56.716306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6283f009-8bc9-4a83-a274-4557ad5fbb78 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1407 microversion: 2.20 time: 0.222195 Jul 18 14:16:56.716860 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 370/718] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:56 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:16:57.317388 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c0eb4dd5-2143-4c7f-99ba-7cbe22a94058 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:57.318319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c0eb4dd5-2143-4c7f-99ba-7cbe22a94058 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:57.325309 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c0eb4dd5-2143-4c7f-99ba-7cbe22a94058 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.325762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c0eb4dd5-2143-4c7f-99ba-7cbe22a94058 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.326524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c0eb4dd5-2143-4c7f-99ba-7cbe22a94058 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.326961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c0eb4dd5-2143-4c7f-99ba-7cbe22a94058 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.356072 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c0eb4dd5-2143-4c7f-99ba-7cbe22a94058 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042541 Jul 18 14:16:57.356616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 349/719] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:16:57 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:16:57.415527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:57.416100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:57.422382 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.422824 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.423750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.424209 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.450653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Going to try to terminate instance {{(pid=117845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:16:57.529730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a2bfb0df-91a8-4bd4-944e-c4844dfe3568 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 204 len: 0 microversion: 2.1 time: 0.117506 Jul 18 14:16:57.531179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 371/720] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:16:57 2022] DELETE /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:16:57.539758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:57.540399 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:57.546763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.547188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.547938 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.548386 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.680715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:57.688583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6afbed31-6321-4fb5-9e3f-4a76e3ae0f08 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1672 microversion: 2.1 time: 0.153313 Jul 18 14:16:57.689136 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 350/721] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:57 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:57.734492 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:57.735173 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:57.741008 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.741447 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.742190 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:57.742609 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:57.878964 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:57.887070 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:57.888613 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:57.889708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-60b080db-ed6e-4c6a-b8b4-07bba072ca86 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1407 microversion: 2.20 time: 0.159364 Jul 18 14:16:57.890294 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 372/722] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:57 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:16:58.706343 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:58.706986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:58.713843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:58.714292 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:58.715051 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:58.715485 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:58.844437 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:58.852409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ff90bda2-519c-4c40-8f3e-ebefebcac3e8 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1672 microversion: 2.1 time: 0.149971 Jul 18 14:16:58.853197 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 351/723] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:58 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:58.907831 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:58.908453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:58.915111 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:58.915560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:58.916868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:58.917303 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:59.014650 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-ef6e249c-d1c7-435b-a387-c0c83c7d2205 req-78130597-9b55-4cce-8264-a040f2fc9b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4858912-7c34-49ae-ad4b-ed96c3ca704a", "name": "network-vif-plugged", "status": "completed", "tag": "d2e80dca-1817-42f8-9092-05e8705d1f77"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:16:59.024406 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ef6e249c-d1c7-435b-a387-c0c83c7d2205 req-78130597-9b55-4cce-8264-a040f2fc9b07 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:59.025698 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ef6e249c-d1c7-435b-a387-c0c83c7d2205 req-78130597-9b55-4cce-8264-a040f2fc9b07 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:59.037936 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-ef6e249c-d1c7-435b-a387-c0c83c7d2205 req-78130597-9b55-4cce-8264-a040f2fc9b07 service nova] Creating event network-vif-plugged:d2e80dca-1817-42f8-9092-05e8705d1f77 for instance c4858912-7c34-49ae-ad4b-ed96c3ca704a on hv-cinder-84984 Jul 18 14:16:59.044360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-ef6e249c-d1c7-435b-a387-c0c83c7d2205 req-78130597-9b55-4cce-8264-a040f2fc9b07 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033491 Jul 18 14:16:59.045239 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 352/724] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:16:59.061413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:59.069726 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:59.071379 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:59.072537 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dd4a96a6-c8ba-4f49-90f9-6dafab429f5a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1407 microversion: 2.20 time: 0.169590 Jul 18 14:16:59.073304 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 373/725] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:16:58 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:16:59.872288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:59.873005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:16:59.879199 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:59.879673 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:59.880646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:16:59.881083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:16:59.956074 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:16:59.963361 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f87bf26c-80e3-478c-9431-5287d20c48c6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1604 microversion: 2.1 time: 0.096358 Jul 18 14:16:59.963921 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 353/726] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:16:59 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1604 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:00.032310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-b2285772-bd25-4904-b11d-f4da8de3a705 req-cf1db2e4-7278-423a-8781-811a765fcfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc44e843-997b-458f-afa5-068509107496", "name": "network-vif-deleted", "tag": "1923e5dd-1caf-42e2-a2c1-17454b860e6f"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:00.041870 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b2285772-bd25-4904-b11d-f4da8de3a705 req-cf1db2e4-7278-423a-8781-811a765fcfdf service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:00.042337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b2285772-bd25-4904-b11d-f4da8de3a705 req-cf1db2e4-7278-423a-8781-811a765fcfdf service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:00.054175 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-b2285772-bd25-4904-b11d-f4da8de3a705 req-cf1db2e4-7278-423a-8781-811a765fcfdf service nova] Creating event network-vif-deleted:1923e5dd-1caf-42e2-a2c1-17454b860e6f for instance bc44e843-997b-458f-afa5-068509107496 on hv-cinder-84984 Jul 18 14:17:00.059929 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-b2285772-bd25-4904-b11d-f4da8de3a705 req-cf1db2e4-7278-423a-8781-811a765fcfdf service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031246 Jul 18 14:17:00.060735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 374/727] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:00.090436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:00.091048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:00.097618 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:00.097984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:00.098760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:00.099197 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:00.510951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:00.519773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:00.520939 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:00.522167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-84b31127-0d1b-4743-bfed-0fb6c6f8de20 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1407 microversion: 2.20 time: 0.435750 Jul 18 14:17:00.532185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 354/728] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:17:00 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:17:00.981748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:00.982499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:00.984514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:00.990179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:00.990633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:00.991415 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:00.991852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.043642 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.045167 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.045617 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lazy-loading 'fault' on Instance uuid bc44e843-997b-458f-afa5-068509107496 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:17:01.090150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:01.097648 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8657c298-e25d-4709-8c38-75796174c231 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 200 len: 1327 microversion: 2.1 time: 0.121287 Jul 18 14:17:01.098360 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 375/729] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:00 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:01.541519 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:01.542736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:01.544870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:01.545569 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:01.552193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.552660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.554127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.554562 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.685514 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:01.693510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:01.695015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:01.696239 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3a5c1a9e-f41b-4851-a546-629ee22e979a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1598 microversion: 2.20 time: 0.159452 Jul 18 14:17:01.697373 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 355/730] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:17:01 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:17:01.714542 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-176983b1-7258-43f0-89fd-fd005705a861 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:01.714961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-176983b1-7258-43f0-89fd-fd005705a861 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:01.720891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176983b1-7258-43f0-89fd-fd005705a861 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.721334 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176983b1-7258-43f0-89fd-fd005705a861 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.722109 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176983b1-7258-43f0-89fd-fd005705a861 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.722537 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-176983b1-7258-43f0-89fd-fd005705a861 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.801027 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-176983b1-7258-43f0-89fd-fd005705a861 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090865 Jul 18 14:17:01.801631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 376/731] 10.222.0.94 () {60 vars in 1315 bytes} [Mon Jul 18 14:17:01 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:17:02.115048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:02.115655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:02.122292 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:02.122742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:02.123500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:02.123933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:02.138053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] HTTP exception thrown: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Request method failure captured: Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 HTTP/1.1 Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlqNNvLNptLx-mqNTXo0XURoUqcyNHsJ2A_iFWO2B-_06sy_HtILfY9NfOVosZSZP2mtIp6sJkvbrlLfMnt2tNmlo49ZDe1ks75qAyvN9CsAkhut9NZd23XfrnAyjn2S7BIcb49pCrHtZlrtBBkTOU4vCXAMvszoqL60mLOC1KXVa0 Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:17:02.139713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_31755010e81b43908bbef9ae75eaaa64"}]}] Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0b6cb92018ea4cc5a25c5423b9bcd7a9 Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:17:02.141367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'bc44e843-997b-458f-afa5-068509107496'} Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:17:02.142266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:17:02.143796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:02.145139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Returning 404 to user: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:17:02.145139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2ca4e8e6-3fee-4a71-a49c-b715fb82c874 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 404 len: 111 microversion: 2.1 time: 0.029964 Jul 18 14:17:02.145139 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 356/732] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:02 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:17:02.150524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2e79a802-f042-41d5-bd1a-6dafb83ef4bc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '.version_select at 0x7f7b3b378670>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:02.167462 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2e79a802-f042-41d5-bd1a-6dafb83ef4bc tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846780889" status: 202 len: 0 microversion: 2.1 time: 0.021123 Jul 18 14:17:02.168222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 377/733] 10.222.0.94 () {58 vars in 1220 bytes} [Mon Jul 18 14:17:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846780889 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:17:02.746705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-33c7bef9-cad2-4670-a8a3-540526b85678 req-a42333eb-8201-4127-bc91-41583612ff09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4858912-7c34-49ae-ad4b-ed96c3ca704a", "tag": "d2e80dca-1817-42f8-9092-05e8705d1f77"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:02.755826 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-33c7bef9-cad2-4670-a8a3-540526b85678 req-a42333eb-8201-4127-bc91-41583612ff09 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:02.756545 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-33c7bef9-cad2-4670-a8a3-540526b85678 req-a42333eb-8201-4127-bc91-41583612ff09 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:02.767885 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-33c7bef9-cad2-4670-a8a3-540526b85678 req-a42333eb-8201-4127-bc91-41583612ff09 service nova] Creating event network-changed:d2e80dca-1817-42f8-9092-05e8705d1f77 for instance c4858912-7c34-49ae-ad4b-ed96c3ca704a on hv-cinder-84984 Jul 18 14:17:02.773287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-33c7bef9-cad2-4670-a8a3-540526b85678 req-a42333eb-8201-4127-bc91-41583612ff09 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030121 Jul 18 14:17:02.774119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 357/734] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:02.819530 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b32717d2-41d6-43da-a207-7d6f06bc5baa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'create', calling method: .version_select at 0x7f7b3b3e1b80>, body: {"keypair": {"name": "tempest-keypair-1193132847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPBvDx6CBgIhc0PyUeXM0j5E4u0frsosYaJ8MOmTYw/SpW7zsL5Ig898Fxnry48ulS9wMQ9uA512FYVDtrmvUdOZ9GJnGvD4uxAdvgYm1SOwvzFxPrI9DlR1REq4YUV9g=="}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:02.834158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-b32717d2-41d6-43da-a207-7d6f06bc5baa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for project 31755010e81b43908bbef9ae75eaaa64. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:17:02.839443 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-b32717d2-41d6-43da-a207-7d6f06bc5baa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for user 0b6cb92018ea4cc5a25c5423b9bcd7a9 and project 31755010e81b43908bbef9ae75eaaa64. Resources: {'key_pairs'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:17:02.862681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b32717d2-41d6-43da-a207-7d6f06bc5baa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047007 Jul 18 14:17:02.863866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 378/735] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:17:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:04.307505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1315351643", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fe5b32f-d5fb-42fb-be1d-85bec4b26b97"}], "security_groups": [{"name": "tempest-securitygroup--1114210546"}], "key_name": "tempest-keypair-1193132847", "user_data": "}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:04.405682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] validate_networks() for [('3fe5b32f-d5fb-42fb-be1d-85bec4b26b97', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:17:04.770587 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:17:04.771077 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:17:04.771603 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:17:04.772228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:17:04.772559 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:17:04.782423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:04.782861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:04.783646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:04.784113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:04.800367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for project 31755010e81b43908bbef9ae75eaaa64. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:17:04.804245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Getting quotas for user 0b6cb92018ea4cc5a25c5423b9bcd7a9 and project 31755010e81b43908bbef9ae75eaaa64. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:17:04.814856 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:17:04.817185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:17:04.860921 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-97afbf9b-3b84-4588-8ac0-8254abb9288b tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.558655 Jul 18 14:17:04.861542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 358/736] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:17:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:17:04.872006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-66f38067-a5bb-49a8-8664-bb9207b91034 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:04.872677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-66f38067-a5bb-49a8-8664-bb9207b91034 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:04.927622 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-66f38067-a5bb-49a8-8664-bb9207b91034 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:04.934965 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-66f38067-a5bb-49a8-8664-bb9207b91034 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1238 microversion: 2.1 time: 0.067449 Jul 18 14:17:04.935643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 379/737] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:04 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:05.952934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:05.954241 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:05.960874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:05.961322 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:05.962650 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:05.963089 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:06.033926 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:06.042027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a0555db1-dbdb-4c1d-9a53-b1fc5c9de49a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1296 microversion: 2.1 time: 0.093621 Jul 18 14:17:06.042576 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 359/738] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:05 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:07.060106 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:07.060732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:07.068878 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:07.069348 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:07.070120 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:07.070551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:07.294229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:07.302362 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ea2fdd73-41d2-4c7e-bdb7-4b2d8f0f4311 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1364 microversion: 2.1 time: 0.247472 Jul 18 14:17:07.302936 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 380/739] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:07 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:07.413054 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-b84f3fec-3e3f-4eb4-9ced-de5bcc465ae8 req-f18e8c85-0f61-414a-aad6-48eb9533168c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd289f6f-0e1a-41ef-9da7-0e6d939f1057", "tag": "29c1e1a6-8c1d-44ea-907e-a70cb53794d2"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:07.428033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b84f3fec-3e3f-4eb4-9ced-de5bcc465ae8 req-f18e8c85-0f61-414a-aad6-48eb9533168c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:07.428483 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b84f3fec-3e3f-4eb4-9ced-de5bcc465ae8 req-f18e8c85-0f61-414a-aad6-48eb9533168c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:07.441232 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-b84f3fec-3e3f-4eb4-9ced-de5bcc465ae8 req-f18e8c85-0f61-414a-aad6-48eb9533168c service nova] Creating event network-changed:29c1e1a6-8c1d-44ea-907e-a70cb53794d2 for instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 on hv-cinder-84984 Jul 18 14:17:07.446642 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-b84f3fec-3e3f-4eb4-9ced-de5bcc465ae8 req-f18e8c85-0f61-414a-aad6-48eb9533168c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039418 Jul 18 14:17:07.447229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 360/740] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:08.319565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:08.320204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:08.326728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:08.327166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:08.327912 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:08.328358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:08.456289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:08.463735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-09d8e14f-8426-45e3-a36f-e9118f550614 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1364 microversion: 2.1 time: 0.147947 Jul 18 14:17:08.464334 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 381/741] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:08 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:09.485895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:09.486976 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:09.493928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:09.494378 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:09.495144 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:09.495606 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:09.624536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:09.631772 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-96374d24-b2cd-4d7b-9788-be03406d388d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1364 microversion: 2.1 time: 0.150014 Jul 18 14:17:09.632731 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 361/742] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:09 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:10.651345 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:10.651865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:10.658291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:10.658729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:10.659490 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:10.659910 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:10.795932 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:10.803221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4493a128-84db-444d-bed8-e5a38cb9a347 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1364 microversion: 2.1 time: 0.156315 Jul 18 14:17:10.803772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 382/743] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:10 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:11.820042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:11.820655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:11.827157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:11.827604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:11.828389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:11.828827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:11.954965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:11.962855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-965ac7b9-ceaa-4d4d-8da3-381e2eed6e45 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1364 microversion: 2.1 time: 0.146688 Jul 18 14:17:11.963415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 362/744] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:11 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:12.980748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:12.981347 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:12.988158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:12.988732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:12.989564 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:12.990175 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:13.103335 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-4bda4864-1305-46fc-af6b-0f80d128ae3c req-fee450d9-139b-4478-9654-a40fb1a22de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd289f6f-0e1a-41ef-9da7-0e6d939f1057", "name": "network-vif-plugged", "status": "completed", "tag": "29c1e1a6-8c1d-44ea-907e-a70cb53794d2"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:13.113152 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4bda4864-1305-46fc-af6b-0f80d128ae3c req-fee450d9-139b-4478-9654-a40fb1a22de5 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:13.113660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4bda4864-1305-46fc-af6b-0f80d128ae3c req-fee450d9-139b-4478-9654-a40fb1a22de5 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:13.125491 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:13.126963 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4bda4864-1305-46fc-af6b-0f80d128ae3c req-fee450d9-139b-4478-9654-a40fb1a22de5 service nova] Creating event network-vif-plugged:29c1e1a6-8c1d-44ea-907e-a70cb53794d2 for instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 on hv-cinder-84984 Jul 18 14:17:13.131839 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-4bda4864-1305-46fc-af6b-0f80d128ae3c req-fee450d9-139b-4478-9654-a40fb1a22de5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Jul 18 14:17:13.132498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 363/745] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:17:13.135040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-fb1befbe-2726-46e0-8a37-73a774ab9f14 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1364 microversion: 2.1 time: 0.158503 Jul 18 14:17:13.136126 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 383/746] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:12 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:14.153170 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:14.153850 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:14.160316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:14.160753 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:14.161547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:14.161973 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:14.296849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:14.304088 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3f8d6bd0-acde-476a-870f-44ca3463fc3a tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1364 microversion: 2.1 time: 0.155495 Jul 18 14:17:14.304639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 364/747] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:14 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:15.322168 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:15.322768 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:15.325066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:15.330578 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:15.331023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:15.331790 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:15.332248 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:15.701301 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:15.708656 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-114f0349-105b-4813-9087-7be46527983f tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1551 microversion: 2.1 time: 0.390402 Jul 18 14:17:15.709251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 384/748] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:15 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1551 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:15.725323 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-46943349-7d67-4d38-9175-ec828dbdd0fa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:15.725929 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-46943349-7d67-4d38-9175-ec828dbdd0fa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:15.728368 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:15.729089 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:15.734956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46943349-7d67-4d38-9175-ec828dbdd0fa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:15.735404 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46943349-7d67-4d38-9175-ec828dbdd0fa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:15.736193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46943349-7d67-4d38-9175-ec828dbdd0fa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:15.736625 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-46943349-7d67-4d38-9175-ec828dbdd0fa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:15.812238 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-46943349-7d67-4d38-9175-ec828dbdd0fa tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090720 Jul 18 14:17:15.812831 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 365/749] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:17:15 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:16.721266 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-2904c953-b43e-4223-91e6-b3725b24358e req-72067bfe-5b71-47a6-846c-43cbbc18108e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd289f6f-0e1a-41ef-9da7-0e6d939f1057", "tag": "29c1e1a6-8c1d-44ea-907e-a70cb53794d2"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:16.729727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-2904c953-b43e-4223-91e6-b3725b24358e req-72067bfe-5b71-47a6-846c-43cbbc18108e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:16.730171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-2904c953-b43e-4223-91e6-b3725b24358e req-72067bfe-5b71-47a6-846c-43cbbc18108e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:16.740828 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-2904c953-b43e-4223-91e6-b3725b24358e req-72067bfe-5b71-47a6-846c-43cbbc18108e service nova] Creating event network-changed:29c1e1a6-8c1d-44ea-907e-a70cb53794d2 for instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 on hv-cinder-84984 Jul 18 14:17:16.746297 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-2904c953-b43e-4223-91e6-b3725b24358e req-72067bfe-5b71-47a6-846c-43cbbc18108e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028439 Jul 18 14:17:16.746896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 385/750] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:25.058825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-96e1b648-43c6-463c-911a-102d95cc131d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:25.059323 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-96e1b648-43c6-463c-911a-102d95cc131d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:25.061149 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:25.068028 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96e1b648-43c6-463c-911a-102d95cc131d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:25.068485 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96e1b648-43c6-463c-911a-102d95cc131d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:25.069246 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96e1b648-43c6-463c-911a-102d95cc131d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:25.069678 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96e1b648-43c6-463c-911a-102d95cc131d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:25.073754 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=93 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:25.093269 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-96e1b648-43c6-463c-911a-102d95cc131d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/ips" status: 200 len: 147 microversion: 2.1 time: 0.038874 Jul 18 14:17:25.093829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 366/751] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:17:25 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:26.408615 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b4b8a812-4a2c-4cc1-93dc-94d4c34dfd11 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3e1598-b161-45f2-a3fd-5db10f42f295"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:26.409753 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b4b8a812-4a2c-4cc1-93dc-94d4c34dfd11 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:26.411662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:26.417545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4b8a812-4a2c-4cc1-93dc-94d4c34dfd11 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:26.417996 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4b8a812-4a2c-4cc1-93dc-94d4c34dfd11 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:26.418762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4b8a812-4a2c-4cc1-93dc-94d4c34dfd11 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:26.419197 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4b8a812-4a2c-4cc1-93dc-94d4c34dfd11 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:26.424045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:26.691400 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b4b8a812-4a2c-4cc1-93dc-94d4c34dfd11 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287661 Jul 18 14:17:26.692016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 386/752] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:17:26 2022] POST /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:34.174552 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3e1598-b161-45f2-a3fd-5db10f42f295"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:34.175608 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:34.182725 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:34.183169 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:34.183922 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:34.184374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:34.260488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Invalid volume: volume 9e3e1598-b161-45f2-a3fd-5db10f42f295 is already attached to instances: 52016ecd-dd32-410d-b6d1-0853b566e1e8 Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: POST /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments HTTP/1.1 Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 74 Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:17:34.262330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {"volumeAttachment": {"volumeId": "9e3e1598-b161-45f2-a3fd-5db10f42f295"}} Jul 18 14:17:34.263999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Invalid volume: volume 9e3e1598-b161-45f2-a3fd-5db10f42f295 is already attached to instances: 52016ecd-dd32-410d-b6d1-0853b566e1e8 Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'server_id': '52016ecd-dd32-410d-b6d1-0853b566e1e8', 'body': {'volumeAttachment': {'volumeId': '9e3e1598-b161-45f2-a3fd-5db10f42f295'}}} Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e3e1598-b161-45f2-a3fd-5db10f42f295 is already attached to instances: 52016ecd-dd32-410d-b6d1-0853b566e1e8 Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:34.265133 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e3e1598-b161-45f2-a3fd-5db10f42f295 is already attached to instances: 52016ecd-dd32-410d-b6d1-0853b566e1e8 Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:34.266620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e3e1598-b161-45f2-a3fd-5db10f42f295 is already attached to instances: 52016ecd-dd32-410d-b6d1-0853b566e1e8 Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 400 to user: Invalid volume: volume 9e3e1598-b161-45f2-a3fd-5db10f42f295 is already attached to instances: 52016ecd-dd32-410d-b6d1-0853b566e1e8 {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ee35b108-306a-4201-8c76-8f022a7aad9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093089 Jul 18 14:17:34.268219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 367/753] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:17:34 2022] POST /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:17:34.325102 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:34.325675 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:34.331738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:34.332211 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:34.332966 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:34.333395 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:34.413550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lazy-loading 'services' on Instance uuid 52016ecd-dd32-410d-b6d1-0853b566e1e8 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:17:34.483854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7b434538-44c1-4e25-a69c-e0f562f5c798 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments/9e3e1598-b161-45f2-a3fd-5db10f42f295" status: 202 len: 0 microversion: 2.1 time: 0.163399 Jul 18 14:17:34.484581 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 387/754] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:17:34 2022] DELETE /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments/9e3e1598-b161-45f2-a3fd-5db10f42f295 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:17:34.492874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-13dd1e90-a866-4b66-891b-3e5cd1a9f56a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:34.494407 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-13dd1e90-a866-4b66-891b-3e5cd1a9f56a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:34.500881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dd1e90-a866-4b66-891b-3e5cd1a9f56a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:34.501359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dd1e90-a866-4b66-891b-3e5cd1a9f56a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:34.502082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dd1e90-a866-4b66-891b-3e5cd1a9f56a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:34.502505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dd1e90-a866-4b66-891b-3e5cd1a9f56a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:34.532207 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-13dd1e90-a866-4b66-891b-3e5cd1a9f56a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 Jul 18 14:17:34.532762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 368/755] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:34 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:35.545550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e7a1581b-65f4-4bf6-a416-5514302bbf73 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:35.546596 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e7a1581b-65f4-4bf6-a416-5514302bbf73 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:35.552734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e7a1581b-65f4-4bf6-a416-5514302bbf73 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:35.553170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e7a1581b-65f4-4bf6-a416-5514302bbf73 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:35.553912 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e7a1581b-65f4-4bf6-a416-5514302bbf73 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:35.554333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e7a1581b-65f4-4bf6-a416-5514302bbf73 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:35.582291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e7a1581b-65f4-4bf6-a416-5514302bbf73 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042451 Jul 18 14:17:35.582838 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 388/756] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:17:35 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:17:35.647040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:35.647605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:35.654779 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:35.655219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:35.656043 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:35.656474 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:35.681094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:17:35.757810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bb6401c3-d164-498b-a8c4-e153b5bc915c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 204 len: 0 microversion: 2.1 time: 0.114354 Jul 18 14:17:35.758870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 369/757] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:17:35 2022] DELETE /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:17:35.771486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:35.772149 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:35.779357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:35.779816 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:35.780616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:35.781054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:35.906957 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:35.914336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-35802bdc-d992-4ebc-9c32-108707a8f247 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1679 microversion: 2.1 time: 0.150330 Jul 18 14:17:35.914900 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 389/758] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:35 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:17:36.933119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:36.933806 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:36.940262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:36.940713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:36.941528 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:36.941965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:37.069944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:37.077851 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b423ae7-55fa-4a1b-94b9-a2ee5d9b0259 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1679 microversion: 2.1 time: 0.149531 Jul 18 14:17:37.078409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 370/759] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:36 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:38.095249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:38.095861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:38.102448 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:38.102895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:38.103874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:38.104387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:38.337981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:38.345464 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2c70e3a5-fd65-4838-9ccd-56e7b9193f32 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1679 microversion: 2.1 time: 0.254110 Jul 18 14:17:38.346030 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 390/760] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:38 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:38.958994 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-cbad5d45-2340-48c3-b096-6e55044b7b9b req-0323a42f-23e6-4f57-a8e6-5d960f63338f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52016ecd-dd32-410d-b6d1-0853b566e1e8", "name": "network-vif-deleted", "tag": "0773cf1a-b729-42e7-9cdd-9186f8cda631"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:38.972221 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-cbad5d45-2340-48c3-b096-6e55044b7b9b req-0323a42f-23e6-4f57-a8e6-5d960f63338f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:38.972933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-cbad5d45-2340-48c3-b096-6e55044b7b9b req-0323a42f-23e6-4f57-a8e6-5d960f63338f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:38.987146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-cbad5d45-2340-48c3-b096-6e55044b7b9b req-0323a42f-23e6-4f57-a8e6-5d960f63338f service nova] Creating event network-vif-deleted:0773cf1a-b729-42e7-9cdd-9186f8cda631 for instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 on hv-cinder-84984 Jul 18 14:17:38.995896 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-cbad5d45-2340-48c3-b096-6e55044b7b9b req-0323a42f-23e6-4f57-a8e6-5d960f63338f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040513 Jul 18 14:17:38.996762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 371/761] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:39.362888 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:39.363500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:39.369827 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:39.370273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:39.371034 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:39.371463 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:39.405341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:39.405778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:39.406253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lazy-loading 'fault' on Instance uuid 52016ecd-dd32-410d-b6d1-0853b566e1e8 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:17:39.449199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:39.457600 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-64506d2a-3fd5-44b3-998b-a07bb88a1461 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 200 len: 1331 microversion: 2.1 time: 0.098679 Jul 18 14:17:39.458745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 391/762] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:39 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:40.476638 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:40.477323 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:40.483977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:40.484429 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:40.485177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:40.485605 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:40.499426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 HTTP/1.1 Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:17:40.501257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:17:40.502871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '52016ecd-dd32-410d-b6d1-0853b566e1e8'} Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:17:40.503828 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:17:40.505501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:17:40.507126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:17:40.507126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fb49c815-ea25-4d74-88fd-6f6d43b52655 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 404 len: 111 microversion: 2.1 time: 0.030690 Jul 18 14:17:40.507126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 372/763] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:40 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:17:40.511366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a85e716d-7b44-4e2e-830e-74a6b4b017d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '.version_select at 0x7f7b43b20160>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:40.528665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a85e716d-7b44-4e2e-830e-74a6b4b017d1 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664986265" status: 202 len: 0 microversion: 2.1 time: 0.021019 Jul 18 14:17:40.529236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 392/764] 10.222.0.94 () {58 vars in 1220 bytes} [Mon Jul 18 14:17:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664986265 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:17:41.373611 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-055d1d74-e214-41ec-b481-142a20104463 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: .version_select at 0x7f7b3b26f8b0>, body: {"keypair": {"name": "tempest-keypair-830209171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHmWtYUp2Je94wOVeEvqbjC7HD6Fl8s/HAN3oXQSCuV8AU5Xjx/xd6uhcMAZB5eEnutndFrF+3DksgJMd0+HPE/3HSyPk/tS379LWxhQVJ7srbK0H3EGj8UYdIeUgcs6Q=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:41.387822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-055d1d74-e214-41ec-b481-142a20104463 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:17:41.391604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-055d1d74-e214-41ec-b481-142a20104463 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:17:41.412879 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-055d1d74-e214-41ec-b481-142a20104463 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043675 Jul 18 14:17:41.413442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 373/765] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:17:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:42.683562 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1792873972", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee89766c-7eb8-4f64-a3df-79441574b226"}], "security_groups": [{"name": "tempest-securitygroup--673650262"}], "key_name": "tempest-keypair-830209171", "user_data": "}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:42.787647 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] validate_networks() for [('ee89766c-7eb8-4f64-a3df-79441574b226', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:17:43.159149 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:17:43.159574 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:17:43.160087 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:17:43.160489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:17:43.160894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:17:43.170405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:43.170843 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:43.171631 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:43.172236 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:43.189085 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:17:43.192857 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Getting quotas for user 0542cd47ba77454ba25170292ed9aeb9 and project 26e4140751cf40c2adbfd92a29afd555. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:17:43.203855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:17:43.206096 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:17:43.252938 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cf540880-94f7-49e9-8494-8d934c853cbf tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.574209 Jul 18 14:17:43.253597 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 393/766] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:17:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:17:43.263689 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fd546d13-2142-443d-9b89-2fc8fdb9c439 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:43.264333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fd546d13-2142-443d-9b89-2fc8fdb9c439 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:43.319311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fd546d13-2142-443d-9b89-2fc8fdb9c439 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:43.325965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fd546d13-2142-443d-9b89-2fc8fdb9c439 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1241 microversion: 2.1 time: 0.066272 Jul 18 14:17:43.326524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 374/767] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:43 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:44.343445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:44.344767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:44.352582 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:44.353795 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:44.354591 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:44.355266 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:44.429865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:44.438993 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2dbdbd0a-787f-4f32-af80-1377c8831f93 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1311 microversion: 2.1 time: 0.099725 Jul 18 14:17:44.439680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 394/768] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:44 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:45.457131 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:45.457671 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:45.464785 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:45.465231 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:45.465997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:45.466424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:45.688687 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:45.704024 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b9c56d51-4843-447d-86f0-682762686dca tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1366 microversion: 2.1 time: 0.251061 Jul 18 14:17:45.704612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 375/769] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:45 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:45.911497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-faf4bcec-a2ae-4f80-a289-abd4fab4a6d8 req-b3f88283-8d80-4404-9630-f79cfd9febcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dba0f43-4d38-4a6e-a79c-12c1d84d4a51", "tag": "02f069f3-ce1b-4c97-b4f0-6abbb70be7cf"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:45.921428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-faf4bcec-a2ae-4f80-a289-abd4fab4a6d8 req-b3f88283-8d80-4404-9630-f79cfd9febcb service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:45.921869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-faf4bcec-a2ae-4f80-a289-abd4fab4a6d8 req-b3f88283-8d80-4404-9630-f79cfd9febcb service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:45.946297 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-faf4bcec-a2ae-4f80-a289-abd4fab4a6d8 req-b3f88283-8d80-4404-9630-f79cfd9febcb service nova] Creating event network-changed:02f069f3-ce1b-4c97-b4f0-6abbb70be7cf for instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 on hv-cinder-84984 Jul 18 14:17:45.954738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-faf4bcec-a2ae-4f80-a289-abd4fab4a6d8 req-b3f88283-8d80-4404-9630-f79cfd9febcb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049003 Jul 18 14:17:45.955394 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 395/770] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:46.304855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:46.305356 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:46.312081 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.312708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.313468 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.313923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.338578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:17:46.413692 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b2d876f-e7d0-45ec-a91f-4f0533f36a45 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "DELETE /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 204 len: 0 microversion: 2.1 time: 0.112466 Jul 18 14:17:46.414289 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 376/771] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:17:46 2022] DELETE /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:17:46.424368 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:46.425069 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:46.431745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.432206 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.432954 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.433378 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.565206 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:46.572628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bf3b32c6-fe7b-42d5-9bd1-9d05e2c4504d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1576 microversion: 2.1 time: 0.152908 Jul 18 14:17:46.573187 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 396/772] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:46 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:46.722431 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:46.723121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:46.729708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.730156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.730907 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:46.731335 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:46.860613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:46.867906 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-eba8c773-3438-45da-89c5-0c2c0ba3693f tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1366 microversion: 2.1 time: 0.149879 Jul 18 14:17:46.868547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 377/773] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:46 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:47.590201 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:47.590839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:47.597279 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.597721 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:47.598477 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.598901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:47.725913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:47.733717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d943eb76-805c-4ab1-80cf-a2a092c1c993 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1576 microversion: 2.1 time: 0.147371 Jul 18 14:17:47.734270 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 397/774] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:47 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:47.884984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:47.885580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:47.891907 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.892398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:47.893142 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:47.893568 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:48.023719 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:48.031031 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-de59d2c6-69e0-4ead-b685-c276346d418a tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1366 microversion: 2.1 time: 0.150337 Jul 18 14:17:48.031581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 378/775] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:47 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:48.750583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:48.751194 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:48.757900 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:48.758386 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:48.759441 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:48.760110 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:48.911799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:48.920374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0dc5d0ca-576d-40cf-a697-94db1d41d059 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1576 microversion: 2.1 time: 0.173537 Jul 18 14:17:48.920969 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 398/776] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:48 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:49.047657 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:49.048262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:49.054762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:49.055215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:49.056016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:49.056455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:49.187175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:49.194570 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f1a34d2b-9298-4aff-9135-6bdd228401ea tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1366 microversion: 2.1 time: 0.151059 Jul 18 14:17:49.195137 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 379/777] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:49 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:49.938412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:49.939022 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:49.946064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:49.946511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:49.947291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:49.947721 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:50.125017 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:50.132645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e979c477-f853-449a-bf9e-26f3cacaf389 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1576 microversion: 2.1 time: 0.198878 Jul 18 14:17:50.133212 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 399/778] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:49 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:50.211744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:50.212407 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:50.218868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:50.219316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:50.220110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:50.220548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:50.350351 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:50.358775 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-23df0720-cb81-41c1-b3bb-d9649973f9ae tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1366 microversion: 2.1 time: 0.150718 Jul 18 14:17:50.359529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 380/779] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:50 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:51.149269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:51.149952 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:51.156484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.156916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:51.157674 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.158096 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:51.341958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-d183f8bc-59ad-415b-876a-a2eb7e1848e5 req-22ad9a3a-d7a9-435a-93b8-94ed0ffd2b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba0f43-4d38-4a6e-a79c-12c1d84d4a51", "name": "network-vif-plugged", "status": "completed", "tag": "02f069f3-ce1b-4c97-b4f0-6abbb70be7cf"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:51.350928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d183f8bc-59ad-415b-876a-a2eb7e1848e5 req-22ad9a3a-d7a9-435a-93b8-94ed0ffd2b7e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.351439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d183f8bc-59ad-415b-876a-a2eb7e1848e5 req-22ad9a3a-d7a9-435a-93b8-94ed0ffd2b7e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:51.364302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-d183f8bc-59ad-415b-876a-a2eb7e1848e5 req-22ad9a3a-d7a9-435a-93b8-94ed0ffd2b7e service nova] Creating event network-vif-plugged:02f069f3-ce1b-4c97-b4f0-6abbb70be7cf for instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 on hv-cinder-84984 Jul 18 14:17:51.371827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-d183f8bc-59ad-415b-876a-a2eb7e1848e5 req-22ad9a3a-d7a9-435a-93b8-94ed0ffd2b7e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033748 Jul 18 14:17:51.372567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 381/780] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:17:51.377970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:51.378881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:51.386300 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:51.391245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.392494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:51.393982 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.394113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a56b49f2-8a16-4bca-87b5-6f3ff42e7cd8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1576 microversion: 2.1 time: 0.248502 Jul 18 14:17:51.394708 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:51.403768 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 400/781] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:51 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1576 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:51.909690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:51.919650 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3691979a-7648-48c0-ab38-3084e6b12b17 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1366 microversion: 2.1 time: 0.545679 Jul 18 14:17:51.920527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 382/782] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:51 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:51.989924 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-7bbaeb42-586f-411b-b681-996bd4a0d60f req-d085a746-9c2c-41f5-8131-9b985b8ee225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5b2707-4b87-4dbd-b986-13ec52ee0f47", "name": "network-vif-deleted", "tag": "aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:51.998435 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-7bbaeb42-586f-411b-b681-996bd4a0d60f req-d085a746-9c2c-41f5-8131-9b985b8ee225 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:51.999263 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-7bbaeb42-586f-411b-b681-996bd4a0d60f req-d085a746-9c2c-41f5-8131-9b985b8ee225 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.012235 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-7bbaeb42-586f-411b-b681-996bd4a0d60f req-d085a746-9c2c-41f5-8131-9b985b8ee225 service nova] Creating event network-vif-deleted:aa7d3c55-67a7-4394-8a2e-3f1bd947dd0c for instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 on hv-cinder-84984 Jul 18 14:17:52.017448 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-7bbaeb42-586f-411b-b681-996bd4a0d60f req-d085a746-9c2c-41f5-8131-9b985b8ee225 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031005 Jul 18 14:17:52.017850 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 401/783] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:17:52.410580 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:52.411193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:52.417738 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.418185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.419215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.419762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.486189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:52.488653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:52.499011 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0ae7a877-6f93-4752-a9a3-14e1883a15a7 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1508 microversion: 2.1 time: 0.092145 Jul 18 14:17:52.499581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 383/784] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:52 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1508 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:52.938186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:52.938980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:52.945365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.945849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:52.946621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:52.947187 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:53.076598 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:53.084199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-61350b9e-2068-44d0-93eb-957744eadcba tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1366 microversion: 2.1 time: 0.150758 Jul 18 14:17:53.084841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 402/785] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:52 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:53.516048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:53.516687 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:53.518871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:53.526023 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:53.526475 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:53.527846 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:53.528346 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:53.562049 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:53.562492 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:53.562944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lazy-loading 'fault' on Instance uuid 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:17:53.616501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:53.626736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8745294f-ac20-4f62-8f7c-2968507be004 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 200 len: 1229 microversion: 2.1 time: 0.114335 Jul 18 14:17:53.627297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 384/786] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:53 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:54.101405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:54.101966 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:54.103893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:54.104777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:54.111857 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.112330 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.113125 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.113558 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.132387 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:54.256814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:54.264976 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2f6a1053-5249-46bf-b454-e8b9958f14eb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1555 microversion: 2.1 time: 0.167499 Jul 18 14:17:54.265532 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 403/787] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:54 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:54.281260 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-020d7afb-18ed-4597-8623-3ba1bdf2f503 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:54.281748 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-020d7afb-18ed-4597-8623-3ba1bdf2f503 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:54.287810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-020d7afb-18ed-4597-8623-3ba1bdf2f503 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.288338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-020d7afb-18ed-4597-8623-3ba1bdf2f503 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.289098 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-020d7afb-18ed-4597-8623-3ba1bdf2f503 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.289527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-020d7afb-18ed-4597-8623-3ba1bdf2f503 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.366061 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-020d7afb-18ed-4597-8623-3ba1bdf2f503 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088721 Jul 18 14:17:54.366649 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 385/788] 10.222.0.94 () {58 vars in 1274 bytes} [Mon Jul 18 14:17:54 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:54.644473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:54.645082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:54.650982 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.651428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.652221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:54.652655 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:54.666392 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] HTTP exception thrown: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Request method failure captured: Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 HTTP/1.1 Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wq8JID3LOqvscPv-Dv3MDT7dH6rIf6JCfaxvsRfh9rbKnGvd_B0sK5QDYmASWHIaU4E_MtHmfY7W-lYMdMfzAMto0tzEdggBAdIiHRFtRxiQMFWYikfLRb2Eww-g70Txp2AB1DGZrSa3rbR0qWyvOOSOEHT4zIRUQl1FpgT9DFVPUs Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:17:54.668033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9df5aea1d29c4a91b82a956e152bd214"}]}] Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 35334a0f92254b5e900aad8c51873809 Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:17:54.669866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '5f5b2707-4b87-4dbd-b986-13ec52ee0f47'} Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:17:54.670747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:17:54.672229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:17:54.673571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Returning 404 to user: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:17:54.673571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-38192984-8849-449d-9def-654c8b4a74c2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 404 len: 111 microversion: 2.1 time: 0.029132 Jul 18 14:17:54.673571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 404/789] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:54 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:17:54.767183 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-953592955", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-843152289", "security_groups": [{"name": "tempest-secgroup-smoke-1037340211"}], "block_device_mapping_v2": [{"uuid": "0c613f03-0485-4509-acb9-4a6481adffec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40dc5af3-b7d1-47c8-a36a-5d52ad3762ee"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:54.953611 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] validate_networks() for [('40dc5af3-b7d1-47c8-a36a-5d52ad3762ee', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:17:55.286262 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:55.612604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:17:55.613029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:17:55.613502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:17:55.613905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:17:55.614022 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-9b758961-d759-4d77-9ac2-3e5de275b4c0 req-89b39487-5c11-4ce2-b2d8-13e658561588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dba0f43-4d38-4a6e-a79c-12c1d84d4a51", "tag": "02f069f3-ce1b-4c97-b4f0-6abbb70be7cf"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:55.614516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:17:55.623626 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-9b758961-d759-4d77-9ac2-3e5de275b4c0 req-89b39487-5c11-4ce2-b2d8-13e658561588 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:55.623836 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:55.624329 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:55.624580 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-9b758961-d759-4d77-9ac2-3e5de275b4c0 req-89b39487-5c11-4ce2-b2d8-13e658561588 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:55.625146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:55.625573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:55.643852 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:17:55.650540 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for user 35334a0f92254b5e900aad8c51873809 and project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:17:55.651539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-9b758961-d759-4d77-9ac2-3e5de275b4c0 req-89b39487-5c11-4ce2-b2d8-13e658561588 service nova] Creating event network-changed:02f069f3-ce1b-4c97-b4f0-6abbb70be7cf for instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 on hv-cinder-84984 Jul 18 14:17:55.656546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-9b758961-d759-4d77-9ac2-3e5de275b4c0 req-89b39487-5c11-4ce2-b2d8-13e658561588 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046498 Jul 18 14:17:55.657450 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 405/790] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:17:55.710958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:17:55.713099 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c613f03-0485-4509-acb9-4a6481adffec',volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:17:55.854857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d50303f7-dca6-4c16-85ee-df55201ef2f1 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.092039 Jul 18 14:17:55.855502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 386/791] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:17:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:17:55.866251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f1eb32b4-3feb-41ca-8f51-74f9d650613b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:55.867185 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f1eb32b4-3feb-41ca-8f51-74f9d650613b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:55.954607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f1eb32b4-3feb-41ca-8f51-74f9d650613b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:55.975512 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f1eb32b4-3feb-41ca-8f51-74f9d650613b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1093 microversion: 2.1 time: 0.112893 Jul 18 14:17:55.976310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 406/792] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:55 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1093 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:56.993711 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:56.994835 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:57.001307 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:57.001758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:57.002525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:57.002961 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:57.086905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:57.096719 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-adcdc0df-ed87-40c4-bb89-d9c8f3075416 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1209 microversion: 2.1 time: 0.107552 Jul 18 14:17:57.098080 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 387/793] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:56 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:58.120155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:58.121033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:58.134240 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:58.138502 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:58.138973 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:58.139886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:58.140393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:58.419145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:58.427715 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c42a9010-ad23-467a-8ca0-7d3cf0ae3947 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.311899 Jul 18 14:17:58.428322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 407/794] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:58 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:59.224353 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:59.224962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:59.230603 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-99417e02-5c26-48b8-844f-06bb2d64efea req-d509b565-e691-4ec8-b2a3-5146a220f441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63c8795-24b6-46d9-95ae-0496378efce1", "tag": "a158e474-2cc0-48e6-9c01-f790a2f7a2a3"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:17:59.235548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:59.235927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:59.237304 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:59.238409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:59.245458 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-99417e02-5c26-48b8-844f-06bb2d64efea req-d509b565-e691-4ec8-b2a3-5146a220f441 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:59.246386 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-99417e02-5c26-48b8-844f-06bb2d64efea req-d509b565-e691-4ec8-b2a3-5146a220f441 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:59.258233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-99417e02-5c26-48b8-844f-06bb2d64efea req-d509b565-e691-4ec8-b2a3-5146a220f441 service nova] Creating event network-changed:a158e474-2cc0-48e6-9c01-f790a2f7a2a3 for instance c63c8795-24b6-46d9-95ae-0496378efce1 on hv-cinder-84984 Jul 18 14:17:59.264146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-99417e02-5c26-48b8-844f-06bb2d64efea req-d509b565-e691-4ec8-b2a3-5146a220f441 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037717 Jul 18 14:17:59.265306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 408/795] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:59.270145 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:17:59.369465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-45ce9815-5f38-47a5-b612-9f7a7f88610d tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "DELETE /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 204 len: 0 microversion: 2.1 time: 0.148154 Jul 18 14:17:59.370152 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 388/796] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:17:59 2022] DELETE /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:17:59.378849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:59.379781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:59.388916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:59.389698 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:59.390674 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:59.391252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:59.446381 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:59.447590 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:17:59.457379 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:59.457855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:59.458784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:59.459218 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:59.619743 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:59.632777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f7a2b596-aebb-4956-a2f8-899bf25bd176 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.257971 Jul 18 14:17:59.633536 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 409/797] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:59 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:17:59.643639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:17:59.651299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-af9281c2-8335-4ca9-b48b-535581f2524a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.209154 Jul 18 14:17:59.651897 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 389/798] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:17:59 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:18:00.650719 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:00.651349 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:00.657899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:00.658337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:00.659084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:00.659506 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:00.667683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:00.668591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:00.675009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:00.675452 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:00.676237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:00.676672 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:00.908019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:00.911538 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:00.915711 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f7b90c98-9556-4949-9919-f71752eee0f6 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1570 microversion: 2.1 time: 0.269557 Jul 18 14:18:00.916427 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 410/799] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:00 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1570 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:00.919153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-efe2de44-bbbc-4f86-bc57-cce713e49cf9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.255232 Jul 18 14:18:00.919972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 390/800] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:00 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:18:01.284218 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-6a6ce8dc-3ede-4ea1-95d8-2c782a88aab8 req-9a4972e0-f080-45c0-ac4b-caf94c421a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8", "tag": "7f708601-2664-4499-b22f-8cc585709539"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:01.292160 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-6a6ce8dc-3ede-4ea1-95d8-2c782a88aab8 req-9a4972e0-f080-45c0-ac4b-caf94c421a4d service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:01.292609 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-6a6ce8dc-3ede-4ea1-95d8-2c782a88aab8 req-9a4972e0-f080-45c0-ac4b-caf94c421a4d service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:01.303352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-6a6ce8dc-3ede-4ea1-95d8-2c782a88aab8 req-9a4972e0-f080-45c0-ac4b-caf94c421a4d service nova] Creating event network-changed:7f708601-2664-4499-b22f-8cc585709539 for instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 on hv-cinder-84984 Jul 18 14:18:01.308577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-6a6ce8dc-3ede-4ea1-95d8-2c782a88aab8 req-9a4972e0-f080-45c0-ac4b-caf94c421a4d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028087 Jul 18 14:18:01.309177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 411/801] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:01.933799 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:01.934471 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:01.935802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:01.941524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:01.942127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:01.943039 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:01.943521 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:01.948497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:01.958460 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:01.958916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:01.959712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:01.960169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:02.049763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:02.057549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6fcfa98b-c20d-4438-bce2-a274396ad7af tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1383 microversion: 2.1 time: 0.128396 Jul 18 14:18:02.058122 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 391/802] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:01 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1383 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:02.156234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:02.163667 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-612b79a6-4754-4061-9a13-f983a9d77397 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.231948 Jul 18 14:18:02.164267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 412/803] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:01 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:18:03.074405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:03.075090 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:03.081508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:03.082026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:03.082841 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:03.083333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:03.159003 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2aa4925080114a33b80e2ca588fbeb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f618e7dff5d7411eb4d4cade50d68607', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:03.167532 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9b1fca16-6e11-478e-93a7-5068605cb16b tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 200 len: 1219 microversion: 2.1 time: 0.097034 Jul 18 14:18:03.168367 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 392/804] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:03 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:03.180981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:03.181655 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:03.188538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:03.188980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:03.189748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:03.190170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:03.576348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-c9fb9c09-c06a-46e7-ae87-64cf6d382782 req-dc4e38d9-6a2d-439c-918e-db2cc084b541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63c8795-24b6-46d9-95ae-0496378efce1", "name": "network-vif-deleted", "tag": "a158e474-2cc0-48e6-9c01-f790a2f7a2a3"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:03.585719 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c9fb9c09-c06a-46e7-ae87-64cf6d382782 req-dc4e38d9-6a2d-439c-918e-db2cc084b541 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:03.586266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-c9fb9c09-c06a-46e7-ae87-64cf6d382782 req-dc4e38d9-6a2d-439c-918e-db2cc084b541 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:03.601473 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-c9fb9c09-c06a-46e7-ae87-64cf6d382782 req-dc4e38d9-6a2d-439c-918e-db2cc084b541 service nova] Creating event network-vif-deleted:a158e474-2cc0-48e6-9c01-f790a2f7a2a3 for instance c63c8795-24b6-46d9-95ae-0496378efce1 on hv-cinder-84984 Jul 18 14:18:03.606549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-c9fb9c09-c06a-46e7-ae87-64cf6d382782 req-dc4e38d9-6a2d-439c-918e-db2cc084b541 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035322 Jul 18 14:18:03.607145 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 393/805] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:18:03.627274 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:03.635333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-386b9d83-9df3-4ec8-89ff-a06b8eccdc6a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.458827 Jul 18 14:18:03.635899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 413/806] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:03 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:04.186169 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:04.186850 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] [instance: c63c8795-24b6-46d9-95ae-0496378efce1] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:04.193009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:04.193450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:04.194205 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:04.194629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:04.207459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] HTTP exception thrown: Instance c63c8795-24b6-46d9-95ae-0496378efce1 could not be found. Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Request method failure captured: Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 HTTP/1.1 Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wn3SOxWa7z2i033Yd4RTDOBe1plBrGn3XX2KB_6ZcvNk09iChaONilK_-LgXlXi7JrEtt9OHXxskLvd--xgwbYz1aVe0rwUgap3OITM6EAWeI5oEXVrjk1cLhGg-r6r49VpYnW0NS1cv_bncXrDqHvxBXN5AruHlAxFXHaGl2YdM_I Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: f618e7dff5d7411eb4d4cade50d68607 Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestShelveInstance-837806685 Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:18:04.209014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/f618e7dff5d7411eb4d4cade50d68607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f618e7dff5d7411eb4d4cade50d68607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f618e7dff5d7411eb4d4cade50d68607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_f618e7dff5d7411eb4d4cade50d68607"}]}] Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestShelveInstance-837806685 Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: f618e7dff5d7411eb4d4cade50d68607 Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestShelveInstance-837806685 Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-TestShelveInstance-837806685-project Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 2aa4925080114a33b80e2ca588fbeb27 Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestShelveInstance-837806685-project Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance c63c8795-24b6-46d9-95ae-0496378efce1 could not be found. Jul 18 14:18:04.210653 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'c63c8795-24b6-46d9-95ae-0496378efce1'} Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63c8795-24b6-46d9-95ae-0496378efce1 could not be found. Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:18:04.211529 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63c8795-24b6-46d9-95ae-0496378efce1 could not be found. Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63c8795-24b6-46d9-95ae-0496378efce1 could not be found. Jul 18 14:18:04.213115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:18:04.214541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Returning 404 to user: Instance c63c8795-24b6-46d9-95ae-0496378efce1 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:18:04.214541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-50cf438c-a718-47ac-b821-d872c9638f7a tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1" status: 404 len: 111 microversion: 2.1 time: 0.028842 Jul 18 14:18:04.214541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 394/807] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:04 2022] GET /compute/v2.1/servers/c63c8795-24b6-46d9-95ae-0496378efce1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:18:04.365596 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f5b53903-2826-496d-ae14-f6462d3466a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] Calling method '.version_select at 0x7f7b43b8c1f0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:04.383797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f5b53903-2826-496d-ae14-f6462d3466a4 tempest-TestShelveInstance-837806685 tempest-TestShelveInstance-837806685-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1494975757" status: 202 len: 0 microversion: 2.1 time: 0.022217 Jul 18 14:18:04.384608 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 414/808] 10.222.0.94 () {58 vars in 1253 bytes} [Mon Jul 18 14:18:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1494975757 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:18:04.652584 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:04.653187 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:04.659044 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:04.659486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:04.660330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:04.660755 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:04.798989 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:04.806525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-524bfe6d-7769-4e37-80de-28453283f6d6 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.158366 Jul 18 14:18:04.807085 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 395/809] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:04 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:05.823764 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:05.824403 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:05.831561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:05.832035 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:05.832811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:05.833267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:05.967010 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:05.974722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6808fc6c-34b5-489f-b0fe-926e4a325b86 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.155907 Jul 18 14:18:05.975664 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 415/810] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:05 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:06.990784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:06.991574 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:06.999263 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:07.000855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:07.003115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:07.003888 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:07.005074 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:07.005578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:07.146917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:07.154949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0e15a865-4310-4c1b-a8b7-3d1a327f9beb tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.168153 Jul 18 14:18:07.155520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 396/811] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:06 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:08.171650 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:08.172317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:08.174288 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:08.181041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:08.181486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:08.182259 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:08.182691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:08.389237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:08.397527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5bed78ff-b6ba-4d53-8ac5-73b3caf42cff tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.229827 Jul 18 14:18:08.406935 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 416/812] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:08 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:09.415280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:09.415984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:09.425377 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:09.425868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:09.427123 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:09.427904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:09.682916 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:09.693981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8494070e-e6e1-4482-bf75-ce75c7324369 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.283380 Jul 18 14:18:09.700925 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 397/813] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:09 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:10.718148 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:10.718945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:10.727209 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:10.728042 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:10.728836 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:10.729268 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:10.869469 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:10.878468 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-aef85655-8b44-466e-9f14-1936f72e92d4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.164290 Jul 18 14:18:10.879046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 417/814] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:10 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:18:11.677273 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-df498f6f-914e-4a4c-b1b2-73568011627e req-728e4793-842d-49bc-ab1e-2c4ea3262c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8", "name": "network-vif-plugged", "status": "completed", "tag": "7f708601-2664-4499-b22f-8cc585709539"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:11.687967 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-df498f6f-914e-4a4c-b1b2-73568011627e req-728e4793-842d-49bc-ab1e-2c4ea3262c15 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:11.688704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-df498f6f-914e-4a4c-b1b2-73568011627e req-728e4793-842d-49bc-ab1e-2c4ea3262c15 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:11.703359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-df498f6f-914e-4a4c-b1b2-73568011627e req-728e4793-842d-49bc-ab1e-2c4ea3262c15 service nova] Creating event network-vif-plugged:7f708601-2664-4499-b22f-8cc585709539 for instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 on hv-cinder-84984 Jul 18 14:18:11.708872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-df498f6f-914e-4a4c-b1b2-73568011627e req-728e4793-842d-49bc-ab1e-2c4ea3262c15 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Jul 18 14:18:11.709631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 398/815] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:11.895522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:11.896252 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:11.903457 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:11.903908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:11.904736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:11.905171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:12.091836 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:12.099662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c58ee76a-df5e-4fb5-890b-ae563a0800ed tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.208007 Jul 18 14:18:12.100273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 418/816] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:11 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:13.117383 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:13.118072 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:13.124192 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:13.124637 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:13.125393 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:13.125824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:13.259434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:13.266845 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ec9cd007-08c6-4375-88f7-36c98cd87e44 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1265 microversion: 2.1 time: 0.154128 Jul 18 14:18:13.267410 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 399/817] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:13 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:14.284870 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:14.285417 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:14.291859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:14.292667 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:14.293424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:14.293854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:14.421676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:14.428978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ea9b1937-c859-4342-ace4-f2cdcccc1927 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1451 microversion: 2.1 time: 0.148043 Jul 18 14:18:14.429527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 419/818] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:14 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:14.445206 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:14.445814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:14.452582 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:14.453031 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:14.453784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:14.454215 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:14.588157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:14.595805 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c1ded48b-9b0d-4f1e-84b2-22ddcf99a488 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1451 microversion: 2.1 time: 0.154388 Jul 18 14:18:14.596395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 400/819] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:14 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:16.179075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-b016deca-069e-4d5f-acab-dced29ab6211 req-850b8f44-0fc1-46f0-ab80-a21c3128da52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8", "tag": "7f708601-2664-4499-b22f-8cc585709539"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:16.188067 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b016deca-069e-4d5f-acab-dced29ab6211 req-850b8f44-0fc1-46f0-ab80-a21c3128da52 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:16.188507 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-b016deca-069e-4d5f-acab-dced29ab6211 req-850b8f44-0fc1-46f0-ab80-a21c3128da52 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:16.199923 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-b016deca-069e-4d5f-acab-dced29ab6211 req-850b8f44-0fc1-46f0-ab80-a21c3128da52 service nova] Creating event network-changed:7f708601-2664-4499-b22f-8cc585709539 for instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 on hv-cinder-84984 Jul 18 14:18:16.204894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-b016deca-069e-4d5f-acab-dced29ab6211 req-850b8f44-0fc1-46f0-ab80-a21c3128da52 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029730 Jul 18 14:18:16.205478 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 420/820] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:18:32.539824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e2efe511-af21-4c1b-8a09-9ab05380e91e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:32.540459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e2efe511-af21-4c1b-8a09-9ab05380e91e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:32.542794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:32.543451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:32.549867 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2efe511-af21-4c1b-8a09-9ab05380e91e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:32.550315 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2efe511-af21-4c1b-8a09-9ab05380e91e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:32.551079 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2efe511-af21-4c1b-8a09-9ab05380e91e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:32.551512 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e2efe511-af21-4c1b-8a09-9ab05380e91e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:32.576521 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e2efe511-af21-4c1b-8a09-9ab05380e91e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/ips" status: 200 len: 150 microversion: 2.20 time: 0.041188 Jul 18 14:18:32.577085 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 401/821] 10.222.0.94 () {60 vars in 1288 bytes} [Mon Jul 18 14:18:32 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:18:34.402941 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:34.403679 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=73 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:34.408395 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:34.409013 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:34.417546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:34.417991 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:34.418752 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:34.419185 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:34.442996 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lazy-loading 'flavor' on Instance uuid c4858912-7c34-49ae-ad4b-ed96c3ca704a {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:18:34.895398 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f5584067-3224-4887-87d7-d8e9bfb83c9f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/action" status: 202 len: 0 microversion: 2.20 time: 0.493836 Jul 18 14:18:34.896033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 421/822] 10.222.0.94 () {62 vars in 1318 bytes} [Mon Jul 18 14:18:34 2022] POST /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:18:34.904233 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:34.905172 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:34.911407 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:34.911691 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:34.912507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:34.912940 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:34.935787 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8b305b1d-6ab4-4675-9fd2-36564858a5f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:34.936468 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8b305b1d-6ab4-4675-9fd2-36564858a5f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:34.945166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b305b1d-6ab4-4675-9fd2-36564858a5f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:34.945628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b305b1d-6ab4-4675-9fd2-36564858a5f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:34.946413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b305b1d-6ab4-4675-9fd2-36564858a5f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:34.946852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b305b1d-6ab4-4675-9fd2-36564858a5f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:34.970963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8b305b1d-6ab4-4675-9fd2-36564858a5f0 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/ips" status: 200 len: 147 microversion: 2.1 time: 0.039315 Jul 18 14:18:34.971530 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 422/823] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:18:34 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:18:35.148153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:35.156108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:35.158158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:35.159507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4c016900-23ca-41cf-b4ef-a07c279f2350 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.259248 Jul 18 14:18:35.160082 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 402/824] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:34 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:36.178372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:36.178984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:36.193606 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:36.194582 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:36.195336 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:36.195760 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:36.298220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-27591e50-067e-476e-9ac2-0067a151afbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d53f82d-0f08-428f-8b2a-4db46958b1c3"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:36.299386 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-27591e50-067e-476e-9ac2-0067a151afbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:36.305738 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-27591e50-067e-476e-9ac2-0067a151afbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:36.306179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-27591e50-067e-476e-9ac2-0067a151afbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:36.306958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-27591e50-067e-476e-9ac2-0067a151afbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:36.307384 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-27591e50-067e-476e-9ac2-0067a151afbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:36.330781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:36.339839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:36.341488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:36.342553 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-146e70bd-0274-427b-97f3-f58241c579e4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.168015 Jul 18 14:18:36.343045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 423/825] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:36 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:36.565112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-27591e50-067e-476e-9ac2-0067a151afbf tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270084 Jul 18 14:18:36.566153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 403/826] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:18:36 2022] POST /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:18:37.361066 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:37.361610 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:37.367979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:37.368426 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:37.369189 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:37.369621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:37.497915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:37.506104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:37.508103 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:37.509238 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3310f3c2-96c5-4301-be4d-b7de793e8783 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.152091 Jul 18 14:18:37.509782 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 424/827] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:37 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:38.528137 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:38.528856 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:38.535134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:38.535579 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:38.536360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:38.536799 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:38.670156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:38.679004 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:38.680581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:38.681827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-84866baa-33b3-45a1-917b-bc7714ebac56 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.158398 Jul 18 14:18:38.682398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 404/828] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:38 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:39.701006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:39.701608 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:39.708070 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:39.708513 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:39.709278 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:39.709710 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:39.839397 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:39.849698 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:39.851732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:39.852887 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a2eb39fb-948e-4c80-bb6b-6d1c76a0a78a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.155871 Jul 18 14:18:39.853466 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 425/829] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:39 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:40.871047 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:40.871776 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:40.878234 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:40.878685 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:40.879442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:40.879874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:41.006553 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:41.014729 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:41.016236 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:41.017404 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9eab890b-559f-4800-ba1c-dd30137c3e71 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.150304 Jul 18 14:18:41.017944 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 405/830] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:40 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:42.035424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:42.036065 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:42.042670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:42.043116 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:42.043860 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:42.044338 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:42.173373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:42.181530 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:42.183053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:42.184371 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-995e82c5-b54b-4ce5-abc6-0f7969e5cb5d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.152777 Jul 18 14:18:42.184937 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 426/831] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:42 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:43.202594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:43.203132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:43.209809 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:43.210264 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:43.211029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:43.211459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:43.340795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:43.348524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:43.350005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:43.351129 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9ea949b9-55dd-47b7-8bf5-a8e5e3185f7d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.152477 Jul 18 14:18:43.351798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 406/832] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:43 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:44.369734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:44.370438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:44.376861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:44.377303 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:44.378068 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:44.378498 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:44.511040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:44.519027 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:44.520550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:44.521800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-18ebe35b-83e6-44a9-ad66-7d82a821b446 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.156024 Jul 18 14:18:44.522340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 427/833] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:44 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:45.298590 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7ea8bca1-3ad2-4a71-9d8a-3805797c3903 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:45.299513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7ea8bca1-3ad2-4a71-9d8a-3805797c3903 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:45.305917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ea8bca1-3ad2-4a71-9d8a-3805797c3903 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:45.306362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ea8bca1-3ad2-4a71-9d8a-3805797c3903 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:45.307122 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ea8bca1-3ad2-4a71-9d8a-3805797c3903 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:45.307553 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7ea8bca1-3ad2-4a71-9d8a-3805797c3903 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:45.336496 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7ea8bca1-3ad2-4a71-9d8a-3805797c3903 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041816 Jul 18 14:18:45.337032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 407/834] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:18:45 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:45.346830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9443baa5-f20f-4b67-808c-4a0529678f76 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:45.347385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9443baa5-f20f-4b67-808c-4a0529678f76 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:45.353459 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9443baa5-f20f-4b67-808c-4a0529678f76 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:45.353897 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9443baa5-f20f-4b67-808c-4a0529678f76 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:45.354642 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9443baa5-f20f-4b67-808c-4a0529678f76 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:45.355065 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9443baa5-f20f-4b67-808c-4a0529678f76 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:45.383803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9443baa5-f20f-4b67-808c-4a0529678f76 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/3d53f82d-0f08-428f-8b2a-4db46958b1c3" status: 200 len: 194 microversion: 2.1 time: 0.040986 Jul 18 14:18:45.384417 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 428/835] 10.222.0.94 () {58 vars in 1412 bytes} [Mon Jul 18 14:18:45 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/3d53f82d-0f08-428f-8b2a-4db46958b1c3 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:45.541303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:45.541911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:45.548035 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:45.548474 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:45.549307 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:45.549657 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:45.699263 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:45.707364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:45.708899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:45.710194 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-832b24b5-d8c1-4b77-8bde-e65cfe701730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.173068 Jul 18 14:18:45.710776 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 408/836] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:45 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:46.714910 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-adb8ca67-d199-4eee-8ffd-dc29fcebef03 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19d983dc-e340-4809-b07a-c8cf9726f5d4"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:46.716107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-adb8ca67-d199-4eee-8ffd-dc29fcebef03 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:46.722407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb8ca67-d199-4eee-8ffd-dc29fcebef03 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:46.722847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb8ca67-d199-4eee-8ffd-dc29fcebef03 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:46.723600 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb8ca67-d199-4eee-8ffd-dc29fcebef03 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:46.724057 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb8ca67-d199-4eee-8ffd-dc29fcebef03 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:46.730108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:46.730740 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:46.737009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:46.737455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:46.738222 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:46.738651 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:46.877330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:46.886453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:46.887970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:46.889120 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e405e799-0d76-4b8f-8881-b10f302c175e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.162918 Jul 18 14:18:46.889666 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 409/837] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:46 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:18:46.985476 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-adb8ca67-d199-4eee-8ffd-dc29fcebef03 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "POST /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274219 Jul 18 14:18:46.986082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 429/838] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:18:46 2022] POST /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:47.907022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:47.907573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:47.914011 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:47.914451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:47.915236 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:47.915932 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:48.049775 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:48.058512 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:48.060208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:48.061358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4cc61a10-1dff-4893-a5c0-f0e67a2b8347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.158287 Jul 18 14:18:48.061920 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 410/839] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:47 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:49.080669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:49.081352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:49.088217 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:49.088656 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:49.089409 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:49.089834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:49.220282 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:49.228092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:49.229567 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:49.230695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d106e8a6-3e6f-4549-9bb8-cf93f095ea1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.154885 Jul 18 14:18:49.231239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 430/840] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:49 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:50.248858 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:50.249369 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:50.255704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:50.256178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:50.257421 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:50.257841 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:50.388216 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:50.396045 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:50.398192 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:50.399335 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-74615935-7122-4ab2-abf8-c89cc403eb8e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.154371 Jul 18 14:18:50.399879 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 411/841] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:50 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:51.418145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:51.418778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:51.425446 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:51.425893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:51.426677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:51.427111 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:51.555267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:51.563250 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:51.564762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:51.565933 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-33c2f484-c0b2-4a23-978e-76e2003c5835 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.151977 Jul 18 14:18:51.566476 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 431/842] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:51 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:52.584203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:52.584715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:52.591062 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:52.591501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:52.592269 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:52.592688 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:52.721596 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:52.729823 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:52.731306 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:52.732463 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e731978e-e9ce-4a7a-9659-ad967d3e2924 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1743 microversion: 2.20 time: 0.152248 Jul 18 14:18:52.733008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 412/843] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:52 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:53.751422 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:53.752062 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:53.758493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:53.758942 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:53.759741 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:53.760204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:53.892653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:53.901157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:53.902645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:53.903787 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f498e037-aee6-4e89-aac8-d36818eb4402 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1743 microversion: 2.20 time: 0.156283 Jul 18 14:18:53.904384 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 432/844] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:53 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:54.469331 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-38706cf7-fbe6-441c-82a3-8c13546bd52d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:54.470254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-38706cf7-fbe6-441c-82a3-8c13546bd52d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:54.476821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38706cf7-fbe6-441c-82a3-8c13546bd52d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.477261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38706cf7-fbe6-441c-82a3-8c13546bd52d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.478018 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38706cf7-fbe6-441c-82a3-8c13546bd52d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.478455 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38706cf7-fbe6-441c-82a3-8c13546bd52d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.507639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-38706cf7-fbe6-441c-82a3-8c13546bd52d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041485 Jul 18 14:18:54.508211 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 413/845] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:18:54 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:54.654036 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b04a2862-a308-4389-8309-3d8c74812000 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:54.654445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b04a2862-a308-4389-8309-3d8c74812000 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:54.660549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b04a2862-a308-4389-8309-3d8c74812000 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.660992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b04a2862-a308-4389-8309-3d8c74812000 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.661743 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b04a2862-a308-4389-8309-3d8c74812000 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.662170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b04a2862-a308-4389-8309-3d8c74812000 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.690222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b04a2862-a308-4389-8309-3d8c74812000 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/3d53f82d-0f08-428f-8b2a-4db46958b1c3" status: 200 len: 194 microversion: 2.1 time: 0.040153 Jul 18 14:18:54.690780 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 433/846] 10.222.0.94 () {58 vars in 1412 bytes} [Mon Jul 18 14:18:54 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/3d53f82d-0f08-428f-8b2a-4db46958b1c3 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:18:54.700743 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:54.701228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:54.707059 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.707505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.708352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.708784 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.788128 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lazy-loading 'services' on Instance uuid dd289f6f-0e1a-41ef-9da7-0e6d939f1057 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:18:54.857803 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-13dbb3de-64f4-4080-b053-8001b7289ceb tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/3d53f82d-0f08-428f-8b2a-4db46958b1c3" status: 202 len: 0 microversion: 2.1 time: 0.160782 Jul 18 14:18:54.858371 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 414/847] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:18:54 2022] DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/3d53f82d-0f08-428f-8b2a-4db46958b1c3 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:18:54.922494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:54.923021 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:54.929491 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.929830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.930580 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:54.931001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:54.950103 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:55.062587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:55.070893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:55.072438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:55.073614 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c5d1f732-60db-473d-923c-165f0ee373d3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1743 microversion: 2.20 time: 0.155002 Jul 18 14:18:55.074174 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 434/848] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:54 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:55.776320 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-ccbfcf72-f284-4e1f-a423-d290ca0401ca req-82537d2e-c34e-4c37-939b-33e01c5cb686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4858912-7c34-49ae-ad4b-ed96c3ca704a", "name": "network-vif-plugged", "status": "completed", "tag": "d2e80dca-1817-42f8-9092-05e8705d1f77"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:18:55.785130 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ccbfcf72-f284-4e1f-a423-d290ca0401ca req-82537d2e-c34e-4c37-939b-33e01c5cb686 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:55.785567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-ccbfcf72-f284-4e1f-a423-d290ca0401ca req-82537d2e-c34e-4c37-939b-33e01c5cb686 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:55.797071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-ccbfcf72-f284-4e1f-a423-d290ca0401ca req-82537d2e-c34e-4c37-939b-33e01c5cb686 service nova] Creating event network-vif-plugged:d2e80dca-1817-42f8-9092-05e8705d1f77 for instance c4858912-7c34-49ae-ad4b-ed96c3ca704a on hv-cinder-84984 Jul 18 14:18:55.801718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-ccbfcf72-f284-4e1f-a423-d290ca0401ca req-82537d2e-c34e-4c37-939b-33e01c5cb686 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029953 Jul 18 14:18:55.802288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 415/849] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:56.091912 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:56.092472 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:56.098810 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:56.099256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:56.100042 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:56.101140 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:56.384830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:56.392846 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:56.394330 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:56.395467 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-91f1eb9e-bef5-4304-8e8a-f6052cfbd003 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1743 microversion: 2.20 time: 0.307591 Jul 18 14:18:56.396027 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 435/850] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:56 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1743 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:57.023049 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-79e0ede3-dd97-4e42-889f-c23fc7708f22 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:57.023637 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-79e0ede3-dd97-4e42-889f-c23fc7708f22 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:57.029915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79e0ede3-dd97-4e42-889f-c23fc7708f22 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:57.030365 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79e0ede3-dd97-4e42-889f-c23fc7708f22 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:57.031149 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79e0ede3-dd97-4e42-889f-c23fc7708f22 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:57.031585 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-79e0ede3-dd97-4e42-889f-c23fc7708f22 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:57.048358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:57.062435 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-79e0ede3-dd97-4e42-889f-c23fc7708f22 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/19d983dc-e340-4809-b07a-c8cf9726f5d4" status: 200 len: 194 microversion: 2.1 time: 0.044349 Jul 18 14:18:57.063000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 416/851] 10.222.0.94 () {58 vars in 1412 bytes} [Mon Jul 18 14:18:57 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/19d983dc-e340-4809-b07a-c8cf9726f5d4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:18:57.072532 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:57.073013 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:57.078839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:57.079276 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:57.080046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:57.080469 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:57.158848 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lazy-loading 'services' on Instance uuid dd289f6f-0e1a-41ef-9da7-0e6d939f1057 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:18:57.228570 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b4797d08-0cf0-40b0-aa69-08774b9088d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/19d983dc-e340-4809-b07a-c8cf9726f5d4" status: 202 len: 0 microversion: 2.1 time: 0.159679 Jul 18 14:18:57.229129 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 436/852] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:18:57 2022] DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments/19d983dc-e340-4809-b07a-c8cf9726f5d4 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:18:57.414448 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:57.415286 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:57.421646 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:57.422080 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:57.422824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:57.423249 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:57.550848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:57.558716 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:57.560227 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:57.561360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-18d54468-4ea5-4615-9ec5-163d0df4c231 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1743 microversion: 2.20 time: 0.151623 Jul 18 14:18:57.561901 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 417/853] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:57 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:58.385260 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1eeb9286-f628-40c1-85c7-fb14104fd576 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:58.386327 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1eeb9286-f628-40c1-85c7-fb14104fd576 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:58.392534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1eeb9286-f628-40c1-85c7-fb14104fd576 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.392979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1eeb9286-f628-40c1-85c7-fb14104fd576 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.393738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1eeb9286-f628-40c1-85c7-fb14104fd576 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.394170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1eeb9286-f628-40c1-85c7-fb14104fd576 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.421899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1eeb9286-f628-40c1-85c7-fb14104fd576 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041987 Jul 18 14:18:58.422426 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 437/854] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:18:58 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:18:58.525342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f6e85a7d-7e04-4412-bc3d-b6bfd96b054d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:58.526286 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f6e85a7d-7e04-4412-bc3d-b6bfd96b054d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:58.532677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6e85a7d-7e04-4412-bc3d-b6bfd96b054d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.533121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6e85a7d-7e04-4412-bc3d-b6bfd96b054d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.533884 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6e85a7d-7e04-4412-bc3d-b6bfd96b054d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.534313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f6e85a7d-7e04-4412-bc3d-b6bfd96b054d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.563160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f6e85a7d-7e04-4412-bc3d-b6bfd96b054d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041653 Jul 18 14:18:58.563630 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 418/855] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:18:58 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:18:58.578372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:58.578977 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:58.585542 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.585992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.586798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.587235 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.620989 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:58.621480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:58.627494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.627935 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.628739 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.629167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.654549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:18:58.720543 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:58.728982 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:58.730516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:58.731697 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7814bc20-0268-42e2-bb26-df6f7b76da3c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1743 microversion: 2.20 time: 0.157230 Jul 18 14:18:58.732266 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 438/856] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:58 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:58.760516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dbe96799-3085-4bde-b8b0-4d0cd794f4d6 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 204 len: 0 microversion: 2.1 time: 0.142969 Jul 18 14:18:58.761233 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 419/857] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:18:58 2022] DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:18:58.769982 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:58.770633 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:58.781454 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.781899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.782663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:58.783096 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:58.909766 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:58.917416 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3c2a4e27-da8a-4e0c-816e-4894b4cada85 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1676 microversion: 2.1 time: 0.151613 Jul 18 14:18:58.917965 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 439/858] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:58 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:18:59.750287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:59.750967 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:59.758065 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:59.758501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:59.759251 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:59.759676 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:59.889695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:59.897441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:59.898924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:18:59.900071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-4c5bd4be-1a49-404e-a79d-c0f32cf856bb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1743 microversion: 2.20 time: 0.153983 Jul 18 14:18:59.900616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 420/859] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:18:59 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:59.934267 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:18:59.934897 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:18:59.941425 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:59.941862 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:59.942622 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:59.943077 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:00.074369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:00.081816 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9ef36227-812e-41ad-b601-f2c1a7e8f4c2 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1676 microversion: 2.1 time: 0.152124 Jul 18 14:19:00.082375 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 440/860] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:18:59 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:00.919750 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:00.920517 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:00.927441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:00.927852 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:00.928662 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:00.929146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:01.098664 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:01.099535 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:01.107016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:01.107667 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:01.108504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:01.108934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:01.239385 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:01.247770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:01.249300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:01.250449 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-57c248f7-3616-4980-a838-6a0e415fc7b9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.334793 Jul 18 14:19:01.251219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 421/861] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:00 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:01.376663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:01.385285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-af08fc1d-e02f-4c2d-bd22-c97e195cec8d tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1676 microversion: 2.1 time: 0.290470 Jul 18 14:19:01.386453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 441/862] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:01 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1676 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:02.028883 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-4a76df71-d893-4446-927b-e91c38ec75ab req-1b91009e-385c-4438-9016-62cb4fd68943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd289f6f-0e1a-41ef-9da7-0e6d939f1057", "name": "network-vif-deleted", "tag": "29c1e1a6-8c1d-44ea-907e-a70cb53794d2"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:02.047174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4a76df71-d893-4446-927b-e91c38ec75ab req-1b91009e-385c-4438-9016-62cb4fd68943 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:02.047898 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4a76df71-d893-4446-927b-e91c38ec75ab req-1b91009e-385c-4438-9016-62cb4fd68943 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:02.064894 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4a76df71-d893-4446-927b-e91c38ec75ab req-1b91009e-385c-4438-9016-62cb4fd68943 service nova] Creating event network-vif-deleted:29c1e1a6-8c1d-44ea-907e-a70cb53794d2 for instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 on hv-cinder-84984 Jul 18 14:19:02.075008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-4a76df71-d893-4446-927b-e91c38ec75ab req-1b91009e-385c-4438-9016-62cb4fd68943 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050237 Jul 18 14:19:02.076711 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 422/863] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:02.271774 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:02.272967 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:02.280324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:02.281102 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:02.281917 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:02.282355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:02.403859 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:02.404974 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:02.412027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:02.412781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:02.414490 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:02.415411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:02.452356 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:02.453167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:02.453955 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lazy-loading 'fault' on Instance uuid dd289f6f-0e1a-41ef-9da7-0e6d939f1057 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:19:02.504925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:02.508642 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6cb92018ea4cc5a25c5423b9bcd7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31755010e81b43908bbef9ae75eaaa64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:02.520122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:02.522532 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-53911d1c-0a2b-4201-87ec-5967865e6172 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 200 len: 1328 microversion: 2.1 time: 0.122929 Jul 18 14:19:02.523826 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:02.525071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 423/864] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:02 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:02.526377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-46b8c2a7-c13f-42e1-92dc-4852243943d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.258845 Jul 18 14:19:02.527216 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 442/865] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:02 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:03.546614 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:03.547161 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:03.547543 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:03.547736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:03.553130 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:03.555421 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:03.555871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:03.556869 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:03.557297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:03.571164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:03.572412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:03.573898 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:03.574745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:03.582070 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] HTTP exception thrown: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Request method failure captured: Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 HTTP/1.1 Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlqNNvLNptLx-mqNTXo0XURoUqcyNHsJ2A_iFWO2B-_06sy_HtILfY9NfOVosZSZP2mtIp6sJkvbrlLfMnt2tNmlo49ZDe1ks75qAyvN9CsAkhut9NZd23XfrnAyjn2S7BIcb49pCrHtZlrtBBkTOU4vCXAMvszoqL60mLOC1KXVa0 Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:19:03.583744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_31755010e81b43908bbef9ae75eaaa64"}]}] Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0b6cb92018ea4cc5a25c5423b9bcd7a9 Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:03.585472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'dd289f6f-0e1a-41ef-9da7-0e6d939f1057'} Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:03.586253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:03.587837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:03.589039 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Returning 404 to user: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:03.589039 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d2803dd1-cac8-437e-b10c-04ec5333d24e tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 404 len: 111 microversion: 2.1 time: 0.048944 Jul 18 14:19:03.590207 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 424/866] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:03 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:03.597247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1cbabf97-4d9a-491b-8113-40f6e4215958 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '.version_select at 0x7f7b43ba73a0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:03.627665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1cbabf97-4d9a-491b-8113-40f6e4215958 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193132847" status: 202 len: 0 microversion: 2.1 time: 0.034002 Jul 18 14:19:03.630530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 425/867] 10.222.0.94 () {58 vars in 1220 bytes} [Mon Jul 18 14:19:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193132847 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:19:03.780619 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:03.790243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:03.794892 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:03.803767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2ed9022e-d9a9-48f8-ab4d-a0977325a590 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.259535 Jul 18 14:19:03.804577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 443/868] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:03 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:04.824408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:04.825965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:04.834126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:04.834572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:04.835997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:04.836472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:05.005830 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:05.015022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:05.016569 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:05.017782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-38d898f2-6995-4b28-92bf-18894d87470f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.198255 Jul 18 14:19:05.018267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 426/869] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:04 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:06.037041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:06.037834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:06.041243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=47 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:06.045895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:06.046747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:06.047309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:06.048162 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:06.188748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:06.198240 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:06.200286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:06.201670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4d826c7a-f8f0-4888-ae8e-d94d9a180e65 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.168540 Jul 18 14:19:06.202493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 444/870] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:06 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:06.751288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:06.751830 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:06.759046 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:06.759502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:06.760303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:06.760917 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:06.775550 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] HTTP exception thrown: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Request method failure captured: Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 HTTP/1.1 Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlqNNvLNptLx-mqNTXo0XURoUqcyNHsJ2A_iFWO2B-_06sy_HtILfY9NfOVosZSZP2mtIp6sJkvbrlLfMnt2tNmlo49ZDe1ks75qAyvN9CsAkhut9NZd23XfrnAyjn2S7BIcb49pCrHtZlrtBBkTOU4vCXAMvszoqL60mLOC1KXVa0 Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:19:06.777127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_31755010e81b43908bbef9ae75eaaa64"}]}] Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0b6cb92018ea4cc5a25c5423b9bcd7a9 Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.778488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'dd289f6f-0e1a-41ef-9da7-0e6d939f1057'} Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:06.782624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.784160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.785594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Returning 404 to user: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:06.785594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aa49cd4e-f7b5-43a1-b365-c44168c97598 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 404 len: 111 microversion: 2.1 time: 0.030999 Jul 18 14:19:06.785594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 427/871] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:19:06 2022] DELETE /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:06.791507 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:06.792324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: dd289f6f-0e1a-41ef-9da7-0e6d939f1057] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:06.798673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:06.799119 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:06.799883 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:06.800341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:06.814486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] HTTP exception thrown: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Request method failure captured: Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 HTTP/1.1 Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlqNNvLNptLx-mqNTXo0XURoUqcyNHsJ2A_iFWO2B-_06sy_HtILfY9NfOVosZSZP2mtIp6sJkvbrlLfMnt2tNmlo49ZDe1ks75qAyvN9CsAkhut9NZd23XfrnAyjn2S7BIcb49pCrHtZlrtBBkTOU4vCXAMvszoqL60mLOC1KXVa0 Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:19:06.816169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_31755010e81b43908bbef9ae75eaaa64"}]}] Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 0b6cb92018ea4cc5a25c5423b9bcd7a9 Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.817692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'dd289f6f-0e1a-41ef-9da7-0e6d939f1057'} Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:06.818579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. Jul 18 14:19:06.820594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.822098 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Returning 404 to user: Instance dd289f6f-0e1a-41ef-9da7-0e6d939f1057 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:06.822098 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5cba2e04-2aa3-4f12-af1e-cbee1a1a4682 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057" status: 404 len: 111 microversion: 2.1 time: 0.030589 Jul 18 14:19:06.822098 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 445/872] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:06 2022] GET /compute/v2.1/servers/dd289f6f-0e1a-41ef-9da7-0e6d939f1057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:07.221052 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:07.221709 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:07.229677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:07.230339 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:07.231303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:07.231741 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:07.393819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:07.402978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:07.404628 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:07.405854 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bb86632c-299d-4c91-9945-a84aff57e8c1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.189087 Jul 18 14:19:07.406658 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 428/873] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:07 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:07.973131 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:07.974202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:07.984665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:07.985135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:07.985916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:07.986358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:08.005583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] HTTP exception thrown: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Request method failure captured: Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: DELETE /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 HTTP/1.1 Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlqNNvLNptLx-mqNTXo0XURoUqcyNHsJ2A_iFWO2B-_06sy_HtILfY9NfOVosZSZP2mtIp6sJkvbrlLfMnt2tNmlo49ZDe1ks75qAyvN9CsAkhut9NZd23XfrnAyjn2S7BIcb49pCrHtZlrtBBkTOU4vCXAMvszoqL60mLOC1KXVa0 Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:19:08.007230 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_31755010e81b43908bbef9ae75eaaa64"}]}] Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 0b6cb92018ea4cc5a25c5423b9bcd7a9 Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.009331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'bc44e843-997b-458f-afa5-068509107496'} Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:08.010237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.011680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.013135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Returning 404 to user: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:08.013135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9d8e72fc-e9f0-408e-90f0-104794c00715 tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "DELETE /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 404 len: 111 microversion: 2.1 time: 0.041249 Jul 18 14:19:08.014226 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 446/874] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:19:07 2022] DELETE /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:08.017972 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:08.018718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] [instance: bc44e843-997b-458f-afa5-068509107496] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:08.025659 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:08.026365 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:08.027364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:08.028024 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:08.042270 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] HTTP exception thrown: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Request method failure captured: Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 HTTP/1.1 Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlqNNvLNptLx-mqNTXo0XURoUqcyNHsJ2A_iFWO2B-_06sy_HtILfY9NfOVosZSZP2mtIp6sJkvbrlLfMnt2tNmlo49ZDe1ks75qAyvN9CsAkhut9NZd23XfrnAyjn2S7BIcb49pCrHtZlrtBBkTOU4vCXAMvszoqL60mLOC1KXVa0 Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:19:08.044408 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/31755010e81b43908bbef9ae75eaaa64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_31755010e81b43908bbef9ae75eaaa64"}]}] Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 31755010e81b43908bbef9ae75eaaa64 Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1933611088 Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0b6cb92018ea4cc5a25c5423b9bcd7a9 Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeTestJSON-1933611088-project Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.045742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'bc44e843-997b-458f-afa5-068509107496'} Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:08.046480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. Jul 18 14:19:08.047770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:19:08.050357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] Returning 404 to user: Instance bc44e843-997b-458f-afa5-068509107496 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:08.051374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1e799a49-1923-42de-b2d0-eaf8de70e20c tempest-AttachVolumeTestJSON-1933611088 tempest-AttachVolumeTestJSON-1933611088-project] 10.222.0.94 "GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496" status: 404 len: 111 microversion: 2.1 time: 0.037121 Jul 18 14:19:08.052417 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 429/875] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:08 2022] GET /compute/v2.1/servers/bc44e843-997b-458f-afa5-068509107496 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:08.426292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:08.427180 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:08.439118 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:08.439727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:08.440809 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:08.441530 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:08.742386 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:08.751454 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:08.753501 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:08.754861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3676d298-83b4-440c-95d5-c7d2ac8cddea tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.332532 Jul 18 14:19:08.755853 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 447/876] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:08 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:09.776278 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:09.777900 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:09.784997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:09.785563 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:09.786487 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:09.787022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:10.045028 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:10.055160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:10.057126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:10.058441 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-96a06f7f-d035-4a21-83b4-29f841f4873e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.288352 Jul 18 14:19:10.059279 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 430/877] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:09 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:11.077437 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:11.078130 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:11.085016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:11.085456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:11.086515 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:11.086946 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:11.291254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:11.299413 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:11.300938 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:11.302090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4fd4001b-8d6a-4b26-9b14-0eb916171a98 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1738 microversion: 2.20 time: 0.228586 Jul 18 14:19:11.302641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 448/878] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:11 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:12.322970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:12.323802 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:12.330937 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:12.332360 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:12.333302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:12.334007 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:12.534194 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:12.545555 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:12.548431 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:12.550339 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cac9da5c-f670-4772-93e6-186a55f20a95 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1720 microversion: 2.20 time: 0.233228 Jul 18 14:19:12.550890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 431/879] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:12 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:13.570552 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:13.571073 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:13.579965 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:13.580482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:13.581469 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:13.582100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:13.716696 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:13.724671 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:13.726145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:13.727284 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-58eed64e-c8ac-4fdc-8542-71398aa691ae tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1720 microversion: 2.20 time: 0.161820 Jul 18 14:19:13.728042 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 449/880] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:13 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:13.824221 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-5001a6b7-6894-436b-a207-1d1bb9657354 req-b805cfb1-8508-4b27-86ae-85a36e093b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4858912-7c34-49ae-ad4b-ed96c3ca704a", "name": "network-vif-unplugged", "status": "completed", "tag": "d2e80dca-1817-42f8-9092-05e8705d1f77"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:13.832709 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-5001a6b7-6894-436b-a207-1d1bb9657354 req-b805cfb1-8508-4b27-86ae-85a36e093b1e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:13.833234 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-5001a6b7-6894-436b-a207-1d1bb9657354 req-b805cfb1-8508-4b27-86ae-85a36e093b1e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:13.845505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-5001a6b7-6894-436b-a207-1d1bb9657354 req-b805cfb1-8508-4b27-86ae-85a36e093b1e service nova] Creating event network-vif-unplugged:d2e80dca-1817-42f8-9092-05e8705d1f77 for instance c4858912-7c34-49ae-ad4b-ed96c3ca704a on hv-cinder-84984 Jul 18 14:19:13.850465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-5001a6b7-6894-436b-a207-1d1bb9657354 req-b805cfb1-8508-4b27-86ae-85a36e093b1e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029851 Jul 18 14:19:13.851050 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 432/881] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:14.745689 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:14.746237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:14.755736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:14.756358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:14.757187 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:14.757622 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:14.906548 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:14.917064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:14.918588 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:14.919736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-18a1b1e7-a8b9-42fa-981d-32e83825c777 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1723 microversion: 2.20 time: 0.178128 Jul 18 14:19:14.920318 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 450/882] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:14 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:14.939460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dafcd649-1fdc-4045-bd07-b9c77b40848a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a197b1d0-7a03-4fde-b8b0-15ff333be322"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:14.942617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dafcd649-1fdc-4045-bd07-b9c77b40848a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:14.951203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dafcd649-1fdc-4045-bd07-b9c77b40848a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:14.951389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dafcd649-1fdc-4045-bd07-b9c77b40848a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:14.952641 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dafcd649-1fdc-4045-bd07-b9c77b40848a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:14.953077 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dafcd649-1fdc-4045-bd07-b9c77b40848a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:15.157797 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:15.251644 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dafcd649-1fdc-4045-bd07-b9c77b40848a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317724 Jul 18 14:19:15.252301 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 433/883] 10.222.0.94 () {62 vars in 1363 bytes} [Mon Jul 18 14:19:14 2022] POST /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:19:15.382159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-acfdfea6-6a08-4459-8f9d-a351ec60a574 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:15.382835 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-acfdfea6-6a08-4459-8f9d-a351ec60a574 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:15.391460 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acfdfea6-6a08-4459-8f9d-a351ec60a574 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:15.392166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acfdfea6-6a08-4459-8f9d-a351ec60a574 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:15.393135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acfdfea6-6a08-4459-8f9d-a351ec60a574 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:15.393794 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-acfdfea6-6a08-4459-8f9d-a351ec60a574 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:15.446207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:15.489249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-acfdfea6-6a08-4459-8f9d-a351ec60a574 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/action" status: 202 len: 0 microversion: 2.20 time: 0.112876 Jul 18 14:19:15.490078 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 451/884] 10.222.0.94 () {62 vars in 1318 bytes} [Mon Jul 18 14:19:15 2022] POST /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:19:15.500306 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:15.500561 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:15.508780 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:15.509237 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:15.510045 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:15.510499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:15.651036 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:15.660668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:15.662497 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:15.663892 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-41952b46-f843-40d0-8cae-a998baf9f370 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1749 microversion: 2.20 time: 0.168791 Jul 18 14:19:15.664957 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 434/885] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:15 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:16.684497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:16.685225 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:16.691228 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:16.691677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:16.692470 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:16.692901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:16.879228 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:16.887987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:16.889793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:16.890947 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-04033313-2b96-476b-9374-81a822cc83c3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1749 microversion: 2.20 time: 0.212257 Jul 18 14:19:16.891484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 452/886] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:16 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1749 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:17.920958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:17.921628 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:17.928615 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:17.929067 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:17.929840 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:17.930273 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:18.067023 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:18.075630 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:18.077148 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:18.078286 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7c1e61c1-87ff-4328-822f-9e7f5c4d5d9d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.161256 Jul 18 14:19:18.078829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 435/887] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:17 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:19.096482 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:19.097125 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:19.103661 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:19.104139 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:19.104912 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:19.105509 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:19.245215 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:19.254421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:19.256876 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:19.258345 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9a17617b-3472-4bf1-aa9c-76c6b4d8ce05 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.165840 Jul 18 14:19:19.259484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 453/888] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:19 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:20.282704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:20.283419 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:20.290719 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:20.291495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:20.292548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:20.293212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:20.467192 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:20.478209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:20.479714 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:20.480898 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-49d68e96-4e6c-4132-a4e8-6d62e025d96e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.202200 Jul 18 14:19:20.481451 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 436/889] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:20 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:21.499092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:21.500490 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:21.508362 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:21.508919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:21.509799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:21.510304 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:21.654598 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:21.663333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:21.665104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:21.666271 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-edae925b-d50c-4eff-9bd3-bc2a5c1812a6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.171087 Jul 18 14:19:21.666811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 454/890] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:21 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:22.693095 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:22.694460 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:22.702507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:22.703225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:22.704249 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:22.705104 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:22.872560 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:22.882495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:22.887574 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:22.887574 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6a2b5887-b1b6-4f4f-8436-ddbd186e87b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.203862 Jul 18 14:19:22.891808 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 437/891] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:22 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:23.910467 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:23.911135 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:23.917987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:23.918492 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:23.919285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:23.919721 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:24.061438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:24.071214 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:24.072985 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:24.074184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7a01c26d-d9cd-4c5c-a49c-3ba8895612b6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.167673 Jul 18 14:19:24.074922 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 455/892] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:23 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:25.093589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:25.094507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:25.101953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:25.102397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:25.103167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:25.103601 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:25.512770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:25.522834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:25.524255 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:25.525587 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8ce14b09-ab54-48fb-853c-000d45921741 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.435885 Jul 18 14:19:25.526664 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 438/893] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:25 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:25.706976 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d60b7df9-1aa2-4076-90de-20a87b327f61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:25.707473 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d60b7df9-1aa2-4076-90de-20a87b327f61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:25.713497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d60b7df9-1aa2-4076-90de-20a87b327f61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:25.713941 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d60b7df9-1aa2-4076-90de-20a87b327f61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:25.714702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d60b7df9-1aa2-4076-90de-20a87b327f61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:25.715137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d60b7df9-1aa2-4076-90de-20a87b327f61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:25.739377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d60b7df9-1aa2-4076-90de-20a87b327f61 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/ips" status: 200 len: 148 microversion: 2.1 time: 0.298034 Jul 18 14:19:25.739925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 456/894] 10.222.0.94 () {58 vars in 1247 bytes} [Mon Jul 18 14:19:25 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/ips => generated 148 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:26.548492 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:26.549246 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:26.555684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:26.556434 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:26.557375 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:26.557968 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:26.705874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:26.715052 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:26.716557 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:26.717923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-708eb34a-9d8c-42f9-996c-17eac424d401 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.177653 Jul 18 14:19:26.718472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 439/895] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:26 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:27.743598 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:27.745076 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:27.752277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:27.753166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:27.754140 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:27.754735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:27.914165 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:27.922798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:27.924319 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:27.925466 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5de7a81f-a48e-453c-b268-7a95bd762768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.186710 Jul 18 14:19:27.926027 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 457/896] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:27 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:28.213638 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-42438ab9-6ae7-42e2-a507-5ee050880a35 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1865e93-77cf-44c6-a6d3-2389052faad2"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:28.214745 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-42438ab9-6ae7-42e2-a507-5ee050880a35 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:28.221670 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42438ab9-6ae7-42e2-a507-5ee050880a35 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.222118 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42438ab9-6ae7-42e2-a507-5ee050880a35 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:28.223165 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42438ab9-6ae7-42e2-a507-5ee050880a35 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.223834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-42438ab9-6ae7-42e2-a507-5ee050880a35 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:28.944220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:28.944827 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:28.952901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.953354 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:28.954324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.954884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:29.087315 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:29.096558 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:29.098045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:29.099206 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2193ac98-bbf5-427e-a761-29e222244ca1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.159018 Jul 18 14:19:29.099757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 458/897] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:28 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:30.120108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:30.120733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:30.127099 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:30.127546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:30.128347 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:30.128784 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:30.255390 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:30.264556 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:30.266122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:30.267302 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-282b3c82-0606-4a11-8acf-902d8a3e0e7f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.151946 Jul 18 14:19:30.267848 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 459/898] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:30 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:31.285879 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:31.286511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:31.293090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:31.293541 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:31.294307 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:31.294743 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:31.425995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:31.434961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:31.436483 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:31.437637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1c0595b6-ca0e-4791-9cfd-296cae6378f0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.155842 Jul 18 14:19:31.438188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 460/899] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:31 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:32.456317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:32.456968 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:32.463316 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:32.463766 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:32.464560 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:32.464996 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:32.592686 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:32.600915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:32.602446 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:32.604168 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d6eaa044-dc71-489f-98c6-953d720c9223 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.152246 Jul 18 14:19:32.604723 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 461/900] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:32 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:33.621395 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:33.621998 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:33.628874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.629326 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:33.630087 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:33.630521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:33.760075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:33.770312 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:33.772318 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:33.773471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a213fe83-3388-4b5c-8cae-3832a6ac5b23 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.156113 Jul 18 14:19:33.774019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 462/901] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:33 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:34.793643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:34.794289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:34.800979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:34.801466 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:34.802231 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:34.802665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:34.932606 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:34.941150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:34.942665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:34.944372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4d953773-29f0-411c-926e-48d9c36598b0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.156039 Jul 18 14:19:34.945141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 463/902] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:34 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:35.961950 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:35.963232 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:35.969775 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.970222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.970987 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.971421 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:36.098194 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:36.107038 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:36.108577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:36.109731 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-36d8d7a7-c026-46cd-8476-6278be3c27a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.151672 Jul 18 14:19:36.110280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 464/903] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:35 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:37.128883 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:37.129543 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:37.131729 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=44 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:37.137992 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.138476 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.139246 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.139688 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.272005 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:37.280529 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:37.282004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:37.283141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-11f9286f-db2a-4fd1-80e0-3b219e5ca2b1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.158220 Jul 18 14:19:37.283685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 465/904] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:37 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:37.470035 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-42438ab9-6ae7-42e2-a507-5ee050880a35 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "POST /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.260536 Jul 18 14:19:37.470824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 440/905] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:19:28 2022] POST /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 194 bytes in 9262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:38.301003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:38.301728 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:38.309007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:38.309457 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:38.310223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:38.310654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:38.438743 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:38.447004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:38.448563 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:38.449695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-92c296c6-e3a9-4a0d-8848-1c502a7fc796 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.152570 Jul 18 14:19:38.450240 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 466/906] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:38 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:39.464989 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:39.469061 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:39.469739 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:39.476781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:39.477220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:39.477968 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:39.478392 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:39.616505 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:39.625124 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:39.626710 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:39.627918 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5ad279b1-7322-4740-b328-78cbcbf3d444 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.164807 Jul 18 14:19:39.628459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 441/907] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:39 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:40.646277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:40.646878 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:40.653882 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.654318 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.655075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.655496 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.789510 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:40.793220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:40.799316 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:40.800803 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:40.801948 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b60dbebc-e73e-4554-aa82-bc061a976844 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.159494 Jul 18 14:19:40.802499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 467/908] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:40 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:41.821515 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:41.822117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:41.828659 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.829112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.829868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.830303 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.956771 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:41.965684 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:41.967193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:41.968384 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-13e6e848-3e90-4f4b-b016-3bb3c110768f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.150699 Jul 18 14:19:41.968938 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 442/909] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:41 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:42.987172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:42.987768 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:42.994961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:42.996010 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:42.996773 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:42.997204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:43.126438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.134819 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.136358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.137506 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f9bcc608-0e3b-4b9c-ad8e-9d537db09fa3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.154841 Jul 18 14:19:43.138052 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 468/910] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:42 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:44.155424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:44.156062 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:44.162543 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.163001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.163761 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.164228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.291871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:44.301026 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:44.302524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:44.303668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-188002e0-66d0-44ab-986d-89f63dc22bb5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.152133 Jul 18 14:19:44.304285 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 443/911] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:44 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:45.322499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:45.323088 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:45.329471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:45.329909 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:45.330660 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:45.331084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:45.465127 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:45.473373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:45.474847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:45.476004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-77a5c49e-ce75-44b0-924a-0f1aca2ffcfc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.157346 Jul 18 14:19:45.476554 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 469/912] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:45 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:46.495101 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:46.496362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:46.502826 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.503267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.504031 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.504457 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.506951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=69,nova_cell1:UPDATE=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:46.633229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.641882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.643372 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.644559 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3f9c6051-2f3b-4061-8174-5399b66be578 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.153519 Jul 18 14:19:46.645110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 444/913] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:46 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:47.662605 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:47.663204 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:47.670725 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:47.671171 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:47.671930 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:47.672384 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:47.804280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:47.812623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:47.814109 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:47.815273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2bc8edd9-5031-463d-9ca5-d9dc1091b6db tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.156614 Jul 18 14:19:47.815814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 470/914] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:47 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:48.833648 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:48.834171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:48.841167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.841616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.842380 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.842814 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.969458 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.977793 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.979325 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.981042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-680e6a41-b002-414f-9998-22806d5d6ab9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.150913 Jul 18 14:19:48.982119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 445/915] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:48 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:50.000352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:50.000961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:50.007606 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.008092 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.008856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.009286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.134961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.143903 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.145424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.146574 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d9c038db-40dd-4b98-bb23-12d9137d682d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.150614 Jul 18 14:19:50.147123 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 471/916] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:49 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:51.163665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:51.164300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:51.171871 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.172387 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.173232 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.173726 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.307887 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:51.316436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:51.317916 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:51.319042 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-74d6be54-dc68-44a2-a820-284571f8e298 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.159286 Jul 18 14:19:51.319612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 446/917] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:51 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:52.340600 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:52.341375 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:52.350706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.351149 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.352181 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.352618 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.501371 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.509805 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.511423 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.512440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1787ba78-9d50-4a4c-adc0-5ff71a0b94dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.177710 Jul 18 14:19:52.512981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 472/918] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:52 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:53.530452 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:53.531674 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:53.538163 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.538608 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.539364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.539795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.670829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.679335 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.680892 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.682035 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-be33ad4e-84e3-49b9-abd0-a3786a65ed1c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.155460 Jul 18 14:19:53.682578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 447/919] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:53 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:54.700756 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:54.701461 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:54.707654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.708134 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.708898 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.709329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.837377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:54.846011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:54.847523 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:54.848721 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4b872c2d-4bb6-470c-91b9-4657f61344f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.151854 Jul 18 14:19:54.849275 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 473/920] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:54 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:55.867338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:55.867868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:55.874254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.875208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.875969 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.876416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.006549 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.014965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.017057 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.018243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-60ec9ad9-b2c3-4c51-a049-a3ce16282008 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.154779 Jul 18 14:19:56.018868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 448/921] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:55 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:57.038438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:57.039041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:57.045872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.046320 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.047668 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.048140 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.182712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.191934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.193448 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.194599 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dc02b4fa-f2cc-493b-8ebc-6fb998186ceb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.160191 Jul 18 14:19:57.195154 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 474/922] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:57 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:58.212895 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:58.213499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:58.220185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.220631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.221385 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.221810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.352337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.361100 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.362575 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.363703 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dff0b415-27f9-48c3-86e8-8e10df8701f3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.154721 Jul 18 14:19:58.364272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 449/923] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:58 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:59.381671 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:59.382268 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:59.388696 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.389130 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.389875 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.390299 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.524120 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.532680 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.534186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.535333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-93d40aed-9587-406f-b4bb-391ccaf6d35a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.157528 Jul 18 14:19:59.535907 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 475/924] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:59 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:00.554178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:00.554696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:00.561249 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.561687 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.562446 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.563445 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.692450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.701794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.704872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.706024 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d608631a-a4c4-4a7a-ad2a-e0deaacc1bfe tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.155798 Jul 18 14:20:00.706578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 450/925] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:00 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:01.725581 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:01.726184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:01.732735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.733179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.733942 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.734374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.870716 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.879747 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.881282 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.882452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-7deaf4f7-0fd9-40f2-99a9-e2338af1a6dc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.160782 Jul 18 14:20:01.883015 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 476/926] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:01 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:01.960668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:01.961160 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:01.967683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.968154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.968915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.969378 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.048992 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lazy-loading 'services' on Instance uuid 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:20:02.118593 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9a4dca5a-4fd5-461f-b408-2019621c81fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments/c1865e93-77cf-44c6-a6d3-2389052faad2" status: 202 len: 0 microversion: 2.1 time: 0.161599 Jul 18 14:20:02.119115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 451/927] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:20:01 2022] DELETE /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments/c1865e93-77cf-44c6-a6d3-2389052faad2 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:20:02.128053 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-94beeb97-92eb-4d70-af85-ec601a43e151 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:02.129074 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-94beeb97-92eb-4d70-af85-ec601a43e151 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:02.135056 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-94beeb97-92eb-4d70-af85-ec601a43e151 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.135507 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-94beeb97-92eb-4d70-af85-ec601a43e151 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.136318 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-94beeb97-92eb-4d70-af85-ec601a43e151 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.136792 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-94beeb97-92eb-4d70-af85-ec601a43e151 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.173780 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-94beeb97-92eb-4d70-af85-ec601a43e151 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050210 Jul 18 14:20:02.174346 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 477/928] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:02 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:02.502394 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-f54d3f93-11ed-4730-9f44-b2c570909782 req-540d14bc-9347-45fe-8d45-037ec75e6db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4858912-7c34-49ae-ad4b-ed96c3ca704a", "name": "network-vif-plugged", "status": "completed", "tag": "d2e80dca-1817-42f8-9092-05e8705d1f77"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:02.512282 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f54d3f93-11ed-4730-9f44-b2c570909782 req-540d14bc-9347-45fe-8d45-037ec75e6db9 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.512696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-f54d3f93-11ed-4730-9f44-b2c570909782 req-540d14bc-9347-45fe-8d45-037ec75e6db9 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.525622 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-f54d3f93-11ed-4730-9f44-b2c570909782 req-540d14bc-9347-45fe-8d45-037ec75e6db9 service nova] Creating event network-vif-plugged:d2e80dca-1817-42f8-9092-05e8705d1f77 for instance c4858912-7c34-49ae-ad4b-ed96c3ca704a on hv-cinder-84984 Jul 18 14:20:02.532309 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-f54d3f93-11ed-4730-9f44-b2c570909782 req-540d14bc-9347-45fe-8d45-037ec75e6db9 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033406 Jul 18 14:20:02.533023 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 452/929] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:02.900886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:02.901765 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:02.909295 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.909732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.910492 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.910916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.041079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.049852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.051356 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.052638 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-def8e7eb-fcf5-4a9d-a6ef-655d71f5e4d9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.155700 Jul 18 14:20:03.053225 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 478/930] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:02 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:03.186267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-09643bb1-f060-4637-9c60-b3d92e515303 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:03.187257 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-09643bb1-f060-4637-9c60-b3d92e515303 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:03.194548 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09643bb1-f060-4637-9c60-b3d92e515303 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.195029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09643bb1-f060-4637-9c60-b3d92e515303 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.195791 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09643bb1-f060-4637-9c60-b3d92e515303 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.196260 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-09643bb1-f060-4637-9c60-b3d92e515303 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.225079 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-09643bb1-f060-4637-9c60-b3d92e515303 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Jul 18 14:20:03.225620 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 453/931] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:03 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:04.071271 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:04.071869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:04.078266 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.078718 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.079456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.079881 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.207465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.215837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.217357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.218499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a99d5561-7850-49ec-8476-1606f4b1bb1a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.151138 Jul 18 14:20:04.219048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 479/932] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:04 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:04.236503 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-47d414f0-19f4-4d00-aa9d-4a02c6d56f4d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:04.237453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-47d414f0-19f4-4d00-aa9d-4a02c6d56f4d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:04.243960 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47d414f0-19f4-4d00-aa9d-4a02c6d56f4d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.244412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47d414f0-19f4-4d00-aa9d-4a02c6d56f4d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.245176 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47d414f0-19f4-4d00-aa9d-4a02c6d56f4d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.245607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-47d414f0-19f4-4d00-aa9d-4a02c6d56f4d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.275098 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-47d414f0-19f4-4d00-aa9d-4a02c6d56f4d tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Jul 18 14:20:04.275677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 454/933] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:04 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:05.237166 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:05.237885 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:05.244923 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.245369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.246141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.246569 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.286507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e3299870-5c56-481d-8c86-c36203b257e7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:05.287423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e3299870-5c56-481d-8c86-c36203b257e7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:05.293782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3299870-5c56-481d-8c86-c36203b257e7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.294220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3299870-5c56-481d-8c86-c36203b257e7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.294980 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3299870-5c56-481d-8c86-c36203b257e7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.295432 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e3299870-5c56-481d-8c86-c36203b257e7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.327260 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e3299870-5c56-481d-8c86-c36203b257e7 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Jul 18 14:20:05.329342 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 455/934] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:05 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:20:05.379411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.387769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.389309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.390499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f7758425-9f47-48b6-ba3f-ad770a0a923b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.157814 Jul 18 14:20:05.391060 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 480/935] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:05 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:06.338685 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fb804ec1-0653-4ad0-a6f7-29e1cf0fb879 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:06.339611 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fb804ec1-0653-4ad0-a6f7-29e1cf0fb879 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:06.346061 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb804ec1-0653-4ad0-a6f7-29e1cf0fb879 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.346502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb804ec1-0653-4ad0-a6f7-29e1cf0fb879 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.347261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb804ec1-0653-4ad0-a6f7-29e1cf0fb879 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.347696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fb804ec1-0653-4ad0-a6f7-29e1cf0fb879 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.376822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fb804ec1-0653-4ad0-a6f7-29e1cf0fb879 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041440 Jul 18 14:20:06.377404 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 456/936] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:06 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:06.408630 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:06.409234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:06.415643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.416133 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.416896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.417331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.556838 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.565613 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.567079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.568239 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3c76574f-6da5-4638-934c-949c76dd78eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.163578 Jul 18 14:20:06.568789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 481/937] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:06 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:07.388206 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2ec05d82-ec95-4bde-90fc-0f4501f078e6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:07.389110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2ec05d82-ec95-4bde-90fc-0f4501f078e6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:07.396283 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ec05d82-ec95-4bde-90fc-0f4501f078e6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.396722 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ec05d82-ec95-4bde-90fc-0f4501f078e6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.397472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ec05d82-ec95-4bde-90fc-0f4501f078e6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.397897 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2ec05d82-ec95-4bde-90fc-0f4501f078e6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.427037 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2ec05d82-ec95-4bde-90fc-0f4501f078e6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042722 Jul 18 14:20:07.427573 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 457/938] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:07 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:07.586041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:07.586549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:07.588926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=34 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:07.594193 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.594632 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.595506 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.595925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.726599 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:07.734849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:07.736435 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:07.737569 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-49d7e869-0a7b-41e5-9812-353c965414dd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.155444 Jul 18 14:20:07.738118 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 482/939] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:07 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:08.438663 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fa96f284-6e49-45cb-8d09-5225ab243c9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:08.440123 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fa96f284-6e49-45cb-8d09-5225ab243c9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:08.446624 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa96f284-6e49-45cb-8d09-5225ab243c9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.447079 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa96f284-6e49-45cb-8d09-5225ab243c9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.447837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa96f284-6e49-45cb-8d09-5225ab243c9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.448290 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa96f284-6e49-45cb-8d09-5225ab243c9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.476511 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fa96f284-6e49-45cb-8d09-5225ab243c9e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 Jul 18 14:20:08.477052 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 458/940] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:08 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:08.755620 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:08.756312 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:08.762734 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.763188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.763929 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.764383 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.893655 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.902036 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.903526 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.904727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e0db2aa1-6d7b-4b9d-907f-9b7e23871c17 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.153026 Jul 18 14:20:08.905285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 483/941] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:08 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:09.488437 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-04aec7f1-9500-4c8a-92b4-5cf225819fed tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:09.489392 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-04aec7f1-9500-4c8a-92b4-5cf225819fed tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:09.491735 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=37 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:09.497002 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04aec7f1-9500-4c8a-92b4-5cf225819fed tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.497447 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04aec7f1-9500-4c8a-92b4-5cf225819fed tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.498208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04aec7f1-9500-4c8a-92b4-5cf225819fed tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.498640 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-04aec7f1-9500-4c8a-92b4-5cf225819fed tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.527247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-04aec7f1-9500-4c8a-92b4-5cf225819fed tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Jul 18 14:20:09.527789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 459/942] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:09 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:09.923215 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:09.924467 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:09.930862 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.931297 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.932074 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.932498 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.951089 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=100 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:10.061899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:10.071510 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:10.073047 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:10.074259 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4e68d9c3-8c5d-4ef2-86e1-9ebff77ea385 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.155127 Jul 18 14:20:10.074847 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 484/943] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:09 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:10.539119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ec35637a-57d7-4b8f-929e-deef3b91095c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:10.540177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ec35637a-57d7-4b8f-929e-deef3b91095c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:10.546791 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec35637a-57d7-4b8f-929e-deef3b91095c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:10.547228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec35637a-57d7-4b8f-929e-deef3b91095c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:10.548008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec35637a-57d7-4b8f-929e-deef3b91095c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:10.549024 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ec35637a-57d7-4b8f-929e-deef3b91095c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:10.574104 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:10.579343 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ec35637a-57d7-4b8f-929e-deef3b91095c tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044119 Jul 18 14:20:10.579966 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 460/944] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:10 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:11.093221 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:11.093765 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:11.100277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.100727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.101488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.101925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.239386 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:11.247880 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:11.249385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:11.250530 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0849d777-914b-405a-9e75-21aec199ae01 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.161349 Jul 18 14:20:11.251084 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 485/945] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:11 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:11.591973 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-24ff10cb-0f30-48c7-8fed-612449811248 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:11.592898 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-24ff10cb-0f30-48c7-8fed-612449811248 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:11.599572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-24ff10cb-0f30-48c7-8fed-612449811248 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.600041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-24ff10cb-0f30-48c7-8fed-612449811248 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.600787 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-24ff10cb-0f30-48c7-8fed-612449811248 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.601213 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-24ff10cb-0f30-48c7-8fed-612449811248 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.630144 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-24ff10cb-0f30-48c7-8fed-612449811248 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042807 Jul 18 14:20:11.630683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 461/946] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:11 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:12.269439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:12.270075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:12.276629 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.277076 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.277839 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.278272 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.409122 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:12.417359 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:12.418859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:12.420046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-02981bc2-af31-4a86-93e8-c9fae1b13e6c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.155013 Jul 18 14:20:12.420601 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 486/947] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:12 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:12.641315 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dd2daa40-cf57-4d73-8b29-3912a8a029d2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:12.642239 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-dd2daa40-cf57-4d73-8b29-3912a8a029d2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:12.648807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd2daa40-cf57-4d73-8b29-3912a8a029d2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.649258 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd2daa40-cf57-4d73-8b29-3912a8a029d2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.650033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd2daa40-cf57-4d73-8b29-3912a8a029d2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.650469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-dd2daa40-cf57-4d73-8b29-3912a8a029d2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.682830 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dd2daa40-cf57-4d73-8b29-3912a8a029d2 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045411 Jul 18 14:20:12.683389 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 462/948] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:12 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:20:12.739758 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:12.740289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:12.746579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.747030 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.747800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.748265 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.777584 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Going to try to terminate instance {{(pid=117845) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:20:12.854953 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-987277df-f8ec-4947-a60d-5237adca33f6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 204 len: 0 microversion: 2.1 time: 0.119365 Jul 18 14:20:12.855610 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 487/949] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:20:12 2022] DELETE /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:20:12.864643 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:12.865354 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:12.871829 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.872319 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.873071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.873501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:13.014506 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:13.022698 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9fed2176-07d2-4fe5-8a7c-6ac79d9a2017 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1679 microversion: 2.1 time: 0.162361 Jul 18 14:20:13.023395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 463/950] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:12 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:13.439406 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:13.440177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:13.446604 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:13.447050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:13.447812 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:13.448276 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:13.580061 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:13.590177 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:13.591676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:13.592849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b02ec6af-e0a3-428a-8703-ed7ddc6e128e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.157781 Jul 18 14:20:13.593405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 488/951] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:13 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:14.039873 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:14.040512 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:14.046932 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.047621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.048415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.048848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.183064 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:14.191502 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-eb817945-12ef-45a5-a3c4-c231ed04909e tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1679 microversion: 2.1 time: 0.155379 Jul 18 14:20:14.192581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 464/952] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:14 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:14.612685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:14.613366 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:14.620800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.621444 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.622273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.622699 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.761880 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:14.771521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:14.773175 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:14.774605 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-df6581fb-9b8e-4e96-bfbb-22b38fcaaec6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1807 microversion: 2.20 time: 0.166571 Jul 18 14:20:14.775157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 489/953] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:14 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:15.209521 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.210158 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.216918 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.217504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.218175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.218602 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.434757 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:15.442472 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-18d2502b-5cec-4836-ad8c-4531eec32689 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1679 microversion: 2.1 time: 0.236725 Jul 18 14:20:15.443037 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 465/954] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:15.793100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.793705 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.800878 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.801396 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.802322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.802892 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.032040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:16.040546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:16.042036 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:16.043187 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-81993a94-af24-450a-978c-e76bfdae26a5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1794 microversion: 2.20 time: 0.254073 Jul 18 14:20:16.055980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 490/955] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1794 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:16.394093 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-71f6be6d-1e59-4a61-9e8c-1ad5ba3069f5 req-d84c8182-65ba-4c1e-a4ba-9fd5e84d544b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dba0f43-4d38-4a6e-a79c-12c1d84d4a51", "name": "network-vif-deleted", "tag": "02f069f3-ce1b-4c97-b4f0-6abbb70be7cf"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:16.404228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-71f6be6d-1e59-4a61-9e8c-1ad5ba3069f5 req-d84c8182-65ba-4c1e-a4ba-9fd5e84d544b service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.404795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-71f6be6d-1e59-4a61-9e8c-1ad5ba3069f5 req-d84c8182-65ba-4c1e-a4ba-9fd5e84d544b service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.437208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-71f6be6d-1e59-4a61-9e8c-1ad5ba3069f5 req-d84c8182-65ba-4c1e-a4ba-9fd5e84d544b service nova] Creating event network-vif-deleted:02f069f3-ce1b-4c97-b4f0-6abbb70be7cf for instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 on hv-cinder-84984 Jul 18 14:20:16.446924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-71f6be6d-1e59-4a61-9e8c-1ad5ba3069f5 req-d84c8182-65ba-4c1e-a4ba-9fd5e84d544b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201140 Jul 18 14:20:16.451009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 466/956] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:20:16.460295 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:16.461111 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:16.467567 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.468195 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.469244 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.470460 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.513574 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.514228 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.514851 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lazy-loading 'fault' on Instance uuid 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:20:16.561231 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0542cd47ba77454ba25170292ed9aeb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e4140751cf40c2adbfd92a29afd555', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:16.569375 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-00473e9e-b9e1-488a-942b-b6001094d994 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 200 len: 1331 microversion: 2.1 time: 0.113534 Jul 18 14:20:16.569944 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 491/957] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:16 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:17.587084 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:17.587805 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:17.595525 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:17.596006 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:17.596802 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:17.597234 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:17.610567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 HTTP/1.1 Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:20:17.612712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:17.614338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '2dba0f43-4d38-4a6e-a79c-12c1d84d4a51'} Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:17.615266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:17.616847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:17.618178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:17.618178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8a73ec11-5c93-45aa-8649-010888ec85fe tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 404 len: 111 microversion: 2.1 time: 0.031312 Jul 18 14:20:17.618178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 467/958] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:17 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:17.622874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-50ab3c29-e1d3-47ec-a0d2-e9c12370fdbb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '.version_select at 0x7f7b3b366040>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:17.641777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-50ab3c29-e1d3-47ec-a0d2-e9c12370fdbb tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-830209171" status: 202 len: 0 microversion: 2.1 time: 0.022636 Jul 18 14:20:17.642351 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 492/959] 10.222.0.94 () {58 vars in 1217 bytes} [Mon Jul 18 14:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-830209171 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:20:19.433687 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:19.434219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:19.441798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:19.442334 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:19.443177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:19.443738 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:19.458173 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 HTTP/1.1 Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:20:19.459721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.461313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '2dba0f43-4d38-4a6e-a79c-12c1d84d4a51'} Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:19.462359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.463857 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.465415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:19.465415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8b8f5523-748e-4ab5-b74e-797e7cc238ad tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 404 len: 111 microversion: 2.1 time: 0.031580 Jul 18 14:20:19.465415 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 468/960] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:20:19 2022] DELETE /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:20:19.470082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:19.470689 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:19.477651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:19.478095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:19.478855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:19.479289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:19.492621 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 HTTP/1.1 Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:20:19.494298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.495779 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '2dba0f43-4d38-4a6e-a79c-12c1d84d4a51'} Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:19.496781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. Jul 18 14:20:19.498516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:19.500019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:19.500019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6463e61d-6473-4ac9-892f-113f5fc25254 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51" status: 404 len: 111 microversion: 2.1 time: 0.030023 Jul 18 14:20:19.500019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 493/961] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:19 2022] GET /compute/v2.1/servers/2dba0f43-4d38-4a6e-a79c-12c1d84d4a51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:20.635751 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:20.636291 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:20.642794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.643243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.644033 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.644470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.657459 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 HTTP/1.1 Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:20:20.658970 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.660494 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '52016ecd-dd32-410d-b6d1-0853b566e1e8'} Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:20.661510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.662952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.664691 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:20.664691 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-6c45d7ce-762e-4ecf-911c-5f831ecea9be tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 404 len: 111 microversion: 2.1 time: 0.028459 Jul 18 14:20:20.664691 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 469/962] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:20:20 2022] DELETE /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:20.669055 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:20.669585 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 52016ecd-dd32-410d-b6d1-0853b566e1e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:20.676776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.677219 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.677988 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.678411 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.692456 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 HTTP/1.1 Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:20:20.693995 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.695550 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '52016ecd-dd32-410d-b6d1-0853b566e1e8'} Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:20.696524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. Jul 18 14:20:20.698100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.699551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 52016ecd-dd32-410d-b6d1-0853b566e1e8 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:20.699551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f57ccda2-b89a-46ef-bf8d-5eea527de530 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8" status: 404 len: 111 microversion: 2.1 time: 0.030493 Jul 18 14:20:20.699551 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 494/963] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:20 2022] GET /compute/v2.1/servers/52016ecd-dd32-410d-b6d1-0853b566e1e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:20.704597 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:20.705083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:20.711313 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.711813 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.712842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.713461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.727789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 HTTP/1.1 Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:20:20.729332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.731134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '639f06f6-c59c-437e-864e-40716395ea05'} Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:20.734842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.736106 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.737855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:20.737855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aa0f15c2-b84f-4db0-8c97-fc28a296f156 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 404 len: 111 microversion: 2.1 time: 0.029927 Jul 18 14:20:20.737855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 470/964] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:20:20 2022] DELETE /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:20.743051 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:20.743667 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: 639f06f6-c59c-437e-864e-40716395ea05] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:20.749798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.750184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.750945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.751380 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.768476 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 HTTP/1.1 Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:20:20.770313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.771735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '639f06f6-c59c-437e-864e-40716395ea05'} Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:20.772527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. Jul 18 14:20:20.776970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:20.778280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance 639f06f6-c59c-437e-864e-40716395ea05 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:20.778280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-556003b7-b4c0-47b4-ae1c-19ed88215957 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05" status: 404 len: 111 microversion: 2.1 time: 0.032932 Jul 18 14:20:20.778280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 495/965] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:20 2022] GET /compute/v2.1/servers/639f06f6-c59c-437e-864e-40716395ea05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:21.908567 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:21.909062 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:21.915428 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:21.915874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:21.916675 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:21.917116 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:21.931030 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: DELETE /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef HTTP/1.1 Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:20:21.932613 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.934180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'e8ef7fb3-7048-49b7-83f5-1342dcd057ef'} Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:21.935174 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.936461 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.937924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:21.937924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-22544c7c-6e43-433f-b7b7-6cb3bb253357 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "DELETE /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 404 len: 111 microversion: 2.1 time: 0.029300 Jul 18 14:20:21.937924 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 471/966] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:20:21 2022] DELETE /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:21.942733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:21.943346 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] [instance: e8ef7fb3-7048-49b7-83f5-1342dcd057ef] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:21.950389 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:21.950846 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:21.951607 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:21.952063 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:21.966777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] HTTP exception thrown: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Request method failure captured: Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef HTTP/1.1 Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WlkeLd56JlGk55CLE9v2kJJO3M3bVrB0L5pMjippFsC6dEwBKAo4BX_x88qSBJcGiZju18zEXDZsteXbRU1wV3-mIm4LetEnVU0shvEBARYYxrK8beNnRfq13AnHpT8QKGcDbn9HpiMc8idAPxRUEAz4tunY9rlsXGJ8a1jNPRWeRA Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:20:21.968388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/26e4140751cf40c2adbfd92a29afd555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_26e4140751cf40c2adbfd92a29afd555"}]}] Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 26e4140751cf40c2adbfd92a29afd555 Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1585147197 Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 0542cd47ba77454ba25170292ed9aeb9 Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeNegativeTest-1585147197-project Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.969793 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'e8ef7fb3-7048-49b7-83f5-1342dcd057ef'} Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:21.970628 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. Jul 18 14:20:21.972141 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:20:21.973706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] Returning 404 to user: Instance e8ef7fb3-7048-49b7-83f5-1342dcd057ef could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:21.973706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-24153259-80a6-4dc1-9a90-7055b1e3c8d6 tempest-AttachVolumeNegativeTest-1585147197 tempest-AttachVolumeNegativeTest-1585147197-project] 10.222.0.94 "GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef" status: 404 len: 111 microversion: 2.1 time: 0.030943 Jul 18 14:20:21.973706 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 496/967] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:21 2022] GET /compute/v2.1/servers/e8ef7fb3-7048-49b7-83f5-1342dcd057ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:55.983337 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-671996047", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-843152289", "security_groups": [{"name": "tempest-secgroup-smoke-1037340211"}], "block_device_mapping_v2": [{"uuid": "7c4109ef-3e9b-4c9a-971c-bca24ed3f73f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "40dc5af3-b7d1-47c8-a36a-5d52ad3762ee"}]}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:55.991867 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=25 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:55.992530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=43 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:56.094085 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.network.neutron [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] validate_networks() for [('40dc5af3-b7d1-47c8-a36a-5d52ad3762ee', None, None, None, None, None)] {{(pid=117846) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:20:56.623773 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Flavor limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:20:56.624225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Image limits 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:20:56.624766 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Flavor pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:20:56.625193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Image pref 0:0:0 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:20:56.625593 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.virt.hardware [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117846) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:20:56.636554 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:56.637053 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:56.637934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:56.638670 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:56.655837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:20:56.659864 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Getting quotas for user 35334a0f92254b5e900aad8c51873809 and project 9df5aea1d29c4a91b82a956e152bd214. Resources: {'ram', 'cores', 'instances'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:20:56.718477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Going to run 1 instances... {{(pid=117846) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:20:56.720606 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c4109ef-3e9b-4c9a-971c-bca24ed3f73f',volume_size=None,volume_type=None)] {{(pid=117846) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:20:56.854259 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-19c3118d-501d-45ef-ac2b-4e9aa3c6750a tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874856 Jul 18 14:20:56.860083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 472/968] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:20:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:20:56.865657 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-27cdb8ab-d456-456e-9f90-6e0be70ac29b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:56.866274 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-27cdb8ab-d456-456e-9f90-6e0be70ac29b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:56.873915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:56.876250 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:56.956288 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-27cdb8ab-d456-456e-9f90-6e0be70ac29b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:56.963913 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-27cdb8ab-d456-456e-9f90-6e0be70ac29b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1093 microversion: 2.1 time: 0.102217 Jul 18 14:20:56.964718 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 497/969] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:56 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:57.982453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:57.983073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:57.993941 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:57.994713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:57.995576 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:57.996089 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:58.079157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:58.087155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-44301450-092a-4fab-b56f-b4d8c48a49ad tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1199 microversion: 2.1 time: 0.109970 Jul 18 14:20:58.088080 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 473/970] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:57 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:59.106899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:59.107374 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:59.114313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:59.115033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:59.116522 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:59.117041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:59.366888 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:59.390524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3646bede-3d65-4bb7-a36c-96f2b6a72871 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1277 microversion: 2.1 time: 0.290465 Jul 18 14:20:59.395237 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 498/971] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:59 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1277 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:59.719836 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-d0d93b46-0988-4f0b-a67e-242a2e7d77e4 req-cc8bc09c-fc81-466d-abd3-6afa13873b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0138d3-545d-4df1-b0aa-33c45c4b7411", "tag": "b1bd83de-a793-4dd0-8ba1-4d29f43fbf51"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:59.739883 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d0d93b46-0988-4f0b-a67e-242a2e7d77e4 req-cc8bc09c-fc81-466d-abd3-6afa13873b2a service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:59.740782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-d0d93b46-0988-4f0b-a67e-242a2e7d77e4 req-cc8bc09c-fc81-466d-abd3-6afa13873b2a service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:59.755395 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-d0d93b46-0988-4f0b-a67e-242a2e7d77e4 req-cc8bc09c-fc81-466d-abd3-6afa13873b2a service nova] Creating event network-changed:b1bd83de-a793-4dd0-8ba1-4d29f43fbf51 for instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 on hv-cinder-84984 Jul 18 14:20:59.775425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-d0d93b46-0988-4f0b-a67e-242a2e7d77e4 req-cc8bc09c-fc81-466d-abd3-6afa13873b2a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059061 Jul 18 14:20:59.776473 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 474/972] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:00.414978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:00.414978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:00.422889 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:00.423422 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:00.424319 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:00.424851 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:00.590754 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:00.604124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-30fe8cba-f96b-4e1d-945e-8c1c08be4031 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.195981 Jul 18 14:21:00.604693 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 499/973] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:00 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:01.622180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:01.622880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:01.629189 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:01.629634 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:01.630405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:01.630843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:01.840875 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:01.848913 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-838f9fe2-301d-40c8-9c11-f26c492eb65b tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.231449 Jul 18 14:21:01.849511 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 475/974] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:01 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:02.866137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:02.866781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:02.873904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:02.874351 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:02.875126 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:02.875584 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:03.027317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:03.034799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-118ab71b-a337-4236-a5c2-8e6c99ce82c4 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.172578 Jul 18 14:21:03.035452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 500/975] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:02 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:04.051518 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:04.052067 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:04.059351 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:04.059796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:04.060576 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:04.061007 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:04.337083 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:04.344430 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7c9cb4b2-b163-4892-97f1-3fe7ba90ac1d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.296779 Jul 18 14:21:04.344986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 476/976] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:04 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:05.360978 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:05.361750 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:05.368735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:05.369186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:05.370499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:05.370945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:05.579002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:05.587502 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-de737363-9053-4a16-9199-9255ecfbad1e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.230424 Jul 18 14:21:05.588334 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 501/977] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:05 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:06.605363 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:06.605995 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:06.612436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:06.612876 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:06.613623 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:06.614052 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:06.646183 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:06.666736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:06.745208 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:06.752480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-45804af7-9e8b-456d-a637-fa36617d15f2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.151557 Jul 18 14:21:06.753229 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 477/978] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:06 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:07.770183 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:07.770799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:07.775289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:07.780587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:07.781040 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:07.781823 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:07.782259 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:07.927164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:07.935145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c98b6121-5f66-4092-a1fb-cb74c5da9561 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.168896 Jul 18 14:21:07.935695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 502/979] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:07 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:08.951849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:08.952599 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:08.959347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:08.959860 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:08.960582 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:08.961109 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:09.094103 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:09.105550 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a50d328d-a85e-4ba3-89aa-ef77c1ca9754 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.157959 Jul 18 14:21:09.106132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 478/980] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:08 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:10.122455 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:10.123004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:10.129408 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:10.129845 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:10.130600 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:10.131140 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:10.263753 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:10.271437 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-83b71f81-eca9-465b-bd86-83eba55d1cb0 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.152707 Jul 18 14:21:10.272023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 503/981] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:10 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:11.288794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:11.289407 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:11.295876 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:11.296352 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:11.297141 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:11.297618 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:11.431004 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:11.438504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8de7339c-7b68-417e-b9c7-5cecdee98218 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.153555 Jul 18 14:21:11.439056 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 479/982] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:11 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:12.454809 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:12.455465 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:12.462022 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:12.462471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:12.463234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:12.463669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:12.596662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:12.604019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c393af76-e8d7-41bf-83ef-4e081cbd71cf tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.153136 Jul 18 14:21:12.604582 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 504/983] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:12 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:13.046089 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-b16f60c6-9074-4fe7-bd24-37b0dd4474c5 req-f811ad0d-228e-4a2c-8020-c5c66eb32718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0138d3-545d-4df1-b0aa-33c45c4b7411", "name": "network-vif-plugged", "status": "completed", "tag": "b1bd83de-a793-4dd0-8ba1-4d29f43fbf51"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:13.054122 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b16f60c6-9074-4fe7-bd24-37b0dd4474c5 req-f811ad0d-228e-4a2c-8020-c5c66eb32718 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:13.054824 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-b16f60c6-9074-4fe7-bd24-37b0dd4474c5 req-f811ad0d-228e-4a2c-8020-c5c66eb32718 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:13.065807 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-b16f60c6-9074-4fe7-bd24-37b0dd4474c5 req-f811ad0d-228e-4a2c-8020-c5c66eb32718 service nova] Creating event network-vif-plugged:b1bd83de-a793-4dd0-8ba1-4d29f43fbf51 for instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 on hv-cinder-84984 Jul 18 14:21:13.070736 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-b16f60c6-9074-4fe7-bd24-37b0dd4474c5 req-f811ad0d-228e-4a2c-8020-c5c66eb32718 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204788 Jul 18 14:21:13.071316 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 480/984] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:13.621235 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:13.621923 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:13.628447 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:13.628930 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:13.629702 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:13.630138 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:13.757872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:13.766054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-65367f9a-6829-47b4-a5e4-8035986c87a9 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.148744 Jul 18 14:21:13.766611 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 505/985] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:13 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:14.784284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:14.784986 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:14.791110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:14.791553 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:14.792333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:14.793388 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:14.943760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:14.952952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-de112588-6926-4121-ac8d-0b5027014837 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1265 microversion: 2.1 time: 0.173332 Jul 18 14:21:14.953566 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 481/986] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:14 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:15.970176 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:15.970781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:15.977235 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:15.977677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:15.978434 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:15.978865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.106128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:16.113527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3578b8cc-e695-458b-bc7b-e394192487e8 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1452 microversion: 2.1 time: 0.147254 Jul 18 14:21:16.114081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 506/987] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:15 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:16.129763 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:16.130370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:16.137424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:16.137864 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.138619 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:16.139045 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.271379 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:16.278731 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-aae364a6-0326-4b68-b88a-b00522931221 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1452 microversion: 2.1 time: 0.152755 Jul 18 14:21:16.279289 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 482/988] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:16 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:18.038142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-9ab81865-5974-4ae7-99c7-38f08aa8e958 req-03d7fddf-356b-49fe-aa33-624be40a9d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0138d3-545d-4df1-b0aa-33c45c4b7411", "tag": "b1bd83de-a793-4dd0-8ba1-4d29f43fbf51"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:18.046846 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-9ab81865-5974-4ae7-99c7-38f08aa8e958 req-03d7fddf-356b-49fe-aa33-624be40a9d96 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.047301 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-9ab81865-5974-4ae7-99c7-38f08aa8e958 req-03d7fddf-356b-49fe-aa33-624be40a9d96 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.058245 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-9ab81865-5974-4ae7-99c7-38f08aa8e958 req-03d7fddf-356b-49fe-aa33-624be40a9d96 service nova] Creating event network-changed:b1bd83de-a793-4dd0-8ba1-4d29f43fbf51 for instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 on hv-cinder-84984 Jul 18 14:21:18.063569 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-9ab81865-5974-4ae7-99c7-38f08aa8e958 req-03d7fddf-356b-49fe-aa33-624be40a9d96 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093147 Jul 18 14:21:18.064382 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 507/989] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:21:35.490396 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7a404174-b600-4ccb-a502-c400fabfb37a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:35.491032 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7a404174-b600-4ccb-a502-c400fabfb37a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:35.493188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:35.493958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=54 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:35.500190 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a404174-b600-4ccb-a502-c400fabfb37a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.500639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a404174-b600-4ccb-a502-c400fabfb37a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.501409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a404174-b600-4ccb-a502-c400fabfb37a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.502260 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7a404174-b600-4ccb-a502-c400fabfb37a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.532294 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7a404174-b600-4ccb-a502-c400fabfb37a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments/a197b1d0-7a03-4fde-b8b0-15ff333be322" status: 200 len: 194 microversion: 2.20 time: 0.045789 Jul 18 14:21:35.537599 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 483/990] 10.222.0.94 () {60 vars in 1453 bytes} [Mon Jul 18 14:21:35 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments/a197b1d0-7a03-4fde-b8b0-15ff333be322 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:21:35.595890 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:35.596651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:35.598994 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=24 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:35.599685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=56 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:35.605655 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.606125 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.606899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.607332 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.696419 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lazy-loading 'services' on Instance uuid c4858912-7c34-49ae-ad4b-ed96c3ca704a {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:21:35.779317 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b7e71268-6d00-4c17-b39f-37222fde2235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments/a197b1d0-7a03-4fde-b8b0-15ff333be322" status: 202 len: 0 microversion: 2.20 time: 0.187567 Jul 18 14:21:35.785449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 508/991] 10.222.0.94 () {60 vars in 1456 bytes} [Mon Jul 18 14:21:35 2022] DELETE /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments/a197b1d0-7a03-4fde-b8b0-15ff333be322 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:21:35.803369 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1190d535-88ea-4a56-98a8-6598f0ad7235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:35.804790 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1190d535-88ea-4a56-98a8-6598f0ad7235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:35.812945 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1190d535-88ea-4a56-98a8-6598f0ad7235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.813442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1190d535-88ea-4a56-98a8-6598f0ad7235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.814329 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1190d535-88ea-4a56-98a8-6598f0ad7235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.815015 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1190d535-88ea-4a56-98a8-6598f0ad7235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.849483 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1190d535-88ea-4a56-98a8-6598f0ad7235 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050292 Jul 18 14:21:35.850185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 484/992] 10.222.0.94 () {60 vars in 1342 bytes} [Mon Jul 18 14:21:35 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:21:36.862369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-04c33d38-bf0b-40e4-99ee-90f012e70768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:36.863365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-04c33d38-bf0b-40e4-99ee-90f012e70768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:36.869579 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04c33d38-bf0b-40e4-99ee-90f012e70768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.870024 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04c33d38-bf0b-40e4-99ee-90f012e70768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.870790 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04c33d38-bf0b-40e4-99ee-90f012e70768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.871220 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-04c33d38-bf0b-40e4-99ee-90f012e70768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.899917 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-04c33d38-bf0b-40e4-99ee-90f012e70768 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042473 Jul 18 14:21:36.900492 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 509/993] 10.222.0.94 () {60 vars in 1342 bytes} [Mon Jul 18 14:21:36 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:36.957821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:36.958401 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:36.964930 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.965373 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.966126 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.966556 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.991558 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:21:37.065726 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3e077286-7920-4dae-abe4-9d7e808e6821 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 204 len: 0 microversion: 2.20 time: 0.111313 Jul 18 14:21:37.066579 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 485/994] 10.222.0.94 () {60 vars in 1279 bytes} [Mon Jul 18 14:21:36 2022] DELETE /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:21:37.074723 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:37.075328 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:37.081769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:37.082200 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:37.082947 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:37.083370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:37.210112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:37.218036 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:37.220101 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:37.221243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e103e2ea-cb81-48c3-a1da-642f2f84abb0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.150437 Jul 18 14:21:37.221797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 510/995] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:37 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:38.241571 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:38.242266 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:38.248702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:38.249149 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:38.250096 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:38.250536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:38.377219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:38.385001 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:38.386477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:38.387601 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5e05bf15-d72c-4ab5-93ee-c1ba4cd02454 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.150359 Jul 18 14:21:38.388248 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 486/996] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:38 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:39.406496 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:39.407096 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:39.413592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:39.414039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:39.414799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:39.415223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:39.619796 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.629069 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.630660 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.631844 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-d2b7fc00-7c94-4f3d-ac25-005956b09964 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1722 microversion: 2.20 time: 0.229865 Jul 18 14:21:39.632656 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 511/997] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:39 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:40.177004 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-8bcccc51-2a61-4c4d-9402-871f102fdbf0 req-dca18375-eded-4821-ac40-b634a46a5914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4858912-7c34-49ae-ad4b-ed96c3ca704a", "name": "network-vif-deleted", "tag": "d2e80dca-1817-42f8-9092-05e8705d1f77"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:40.186664 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8bcccc51-2a61-4c4d-9402-871f102fdbf0 req-dca18375-eded-4821-ac40-b634a46a5914 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.187150 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-8bcccc51-2a61-4c4d-9402-871f102fdbf0 req-dca18375-eded-4821-ac40-b634a46a5914 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.199110 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-8bcccc51-2a61-4c4d-9402-871f102fdbf0 req-dca18375-eded-4821-ac40-b634a46a5914 service nova] Creating event network-vif-deleted:d2e80dca-1817-42f8-9092-05e8705d1f77 for instance c4858912-7c34-49ae-ad4b-ed96c3ca704a on hv-cinder-84984 Jul 18 14:21:40.204875 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-8bcccc51-2a61-4c4d-9402-871f102fdbf0 req-dca18375-eded-4821-ac40-b634a46a5914 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031337 Jul 18 14:21:40.208526 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 487/998] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:40.654087 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:40.654963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:40.665499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.668365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.669481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.669953 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.707973 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.708674 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.709132 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lazy-loading 'fault' on Instance uuid c4858912-7c34-49ae-ad4b-ed96c3ca704a {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:21:40.782692 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.792672 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.794778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.796112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-10f6e943-f4f3-4fcc-a9fd-d483bd28ae62 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 200 len: 1372 microversion: 2.20 time: 0.147055 Jul 18 14:21:40.796894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 512/999] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:40 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:41.815540 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:41.816268 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:41.822514 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.822963 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:41.823781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.824185 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:41.836981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] HTTP exception thrown: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Request method failure captured: Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a HTTP/1.1 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WtQ2RBeif8Sx9S2FnAHWHvPs86URT48ClicheKfWgH80B8SwrGCG2sqCZkiDvVhkRFqhrVAPwkb0COC1eJXDH0UD3jchjM38ValWChmcomnh5oFZ4DY7syjcvUwfErLLVgORHEk8a7Ki12pDszpztktOkccQ588jqWl7mdg84JAvt0 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:21:41.838589 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3e0348cc781c4af3bfc3302499b19c74"}]}] Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 8561df96cd7c47c89d283e36fc637bb0 Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:21:41.840357 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'c4858912-7c34-49ae-ad4b-ed96c3ca704a'} Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:21:41.841347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:21:41.842952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:21:41.844495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Returning 404 to user: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:21:41.844495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9e3c2cce-4960-42d7-b9f6-1305444a42fd tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 404 len: 111 microversion: 2.20 time: 0.029771 Jul 18 14:21:41.844495 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 488/1000] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:41 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:21:41.848849 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-32c8e79f-61a5-45a5-8eb4-e45251c033e2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '.version_select at 0x7f7b3b378670>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:41.865897 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-32c8e79f-61a5-45a5-8eb4-e45251c033e2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853498577" status: 204 len: 0 microversion: 2.20 time: 0.020864 Jul 18 14:21:41.866444 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 513/1001] 10.222.0.94 () {60 vars in 1261 bytes} [Mon Jul 18 14:21:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853498577 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:21:42.730960 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2dedc617-6077-4ace-a782-f4b2471598e0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'create', calling method: .version_select at 0x7f7b43b96d30>, body: {"keypair": {"name": "tempest-keypair-2095628274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKfvRSxSTaZY55zYag/6UNjlaCPTIj0ZmLhh5f45e1IQaNmJkyDa3lkU49hugvD0MyPgSXk4M+0G76EtPAjm9o1TrkMg/KfrIp4PaagD2qgMZ0/K6k7nP/EcyKROKEyvVQ=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:42.745116 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2dedc617-6077-4ace-a782-f4b2471598e0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:21:42.748899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-2dedc617-6077-4ace-a782-f4b2471598e0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for user 8561df96cd7c47c89d283e36fc637bb0 and project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:21:42.760517 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2dedc617-6077-4ace-a782-f4b2471598e0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [b74bd8ff-763f-4700-aeb3-be3cd5f97fcb] AMQP server on 10.222.0.94:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:21:43.768151 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [None req-2dedc617-6077-4ace-a782-f4b2471598e0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [b74bd8ff-763f-4700-aeb3-be3cd5f97fcb] Reconnected to AMQP server on 10.222.0.94:5672 via [amqp] client with port 33142. Jul 18 14:21:43.783962 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2dedc617-6077-4ace-a782-f4b2471598e0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.056816 Jul 18 14:21:43.784822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 489/1002] 10.222.0.94 () {62 vars in 1199 bytes} [Mon Jul 18 14:21:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1058 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 14:21:45.036758 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-14640433", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20020f83-2428-4bfd-81fa-0f1a764c36bd"}], "security_groups": [{"name": "tempest-securitygroup--1359402005"}], "key_name": "tempest-keypair-2095628274", "user_data": "}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:45.135113 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] validate_networks() for [('20020f83-2428-4bfd-81fa-0f1a764c36bd', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:21:45.551935 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:21:45.552380 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:21:45.552852 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:21:45.553260 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:21:45.553668 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:21:45.563253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.563695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.564524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.564971 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.581070 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:21:45.584952 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Getting quotas for user 8561df96cd7c47c89d283e36fc637bb0 and project 3e0348cc781c4af3bfc3302499b19c74. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:21:45.595757 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:21:45.597979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:21:45.643433 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR oslo.messaging._drivers.impl_rabbit [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [55e6da74-303f-453a-b8da-d5e8298d7b7a] AMQP server on 10.222.0.94:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:21:46.650449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [55e6da74-303f-453a-b8da-d5e8298d7b7a] Reconnected to AMQP server on 10.222.0.94:5672 via [amqp] client with port 33170. Jul 18 14:21:46.654155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-011c714b-d5ce-4d55-aefb-fd0afc3b3c0c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.622262 Jul 18 14:21:46.654795 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 514/1003] 10.222.0.94 () {62 vars in 1187 bytes} [Mon Jul 18 14:21:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 14:21:46.665350 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e6d26bed-9239-4ebe-b613-97ca0a0a131c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:46.666041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e6d26bed-9239-4ebe-b613-97ca0a0a131c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:46.719228 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e6d26bed-9239-4ebe-b613-97ca0a0a131c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:46.726372 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e6d26bed-9239-4ebe-b613-97ca0a0a131c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:46.727870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e6d26bed-9239-4ebe-b613-97ca0a0a131c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:46.728987 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e6d26bed-9239-4ebe-b613-97ca0a0a131c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1280 microversion: 2.20 time: 0.068094 Jul 18 14:21:46.729541 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 490/1004] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:46 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:47.747732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0dbcb731-565c-4d85-9ec9-c8c9e2058ec0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:47.748367 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0dbcb731-565c-4d85-9ec9-c8c9e2058ec0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:47.810082 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0dbcb731-565c-4d85-9ec9-c8c9e2058ec0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.817299 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0dbcb731-565c-4d85-9ec9-c8c9e2058ec0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.818833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0dbcb731-565c-4d85-9ec9-c8c9e2058ec0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.819927 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0dbcb731-565c-4d85-9ec9-c8c9e2058ec0 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1280 microversion: 2.20 time: 0.076581 Jul 18 14:21:47.820497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 515/1005] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:47 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:48.838123 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fd906404-077e-4c93-9b10-8ee33402f074 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:48.839003 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fd906404-077e-4c93-9b10-8ee33402f074 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:48.893129 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fd906404-077e-4c93-9b10-8ee33402f074 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:48.900912 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fd906404-077e-4c93-9b10-8ee33402f074 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:48.902402 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fd906404-077e-4c93-9b10-8ee33402f074 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:48.903482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fd906404-077e-4c93-9b10-8ee33402f074 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1280 microversion: 2.20 time: 0.069282 Jul 18 14:21:48.904075 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 491/1006] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:48 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:49.979833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-257cd0db-74f5-48a0-83ee-49b0096b4c9a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:49.980479 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-257cd0db-74f5-48a0-83ee-49b0096b4c9a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:50.037963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-257cd0db-74f5-48a0-83ee-49b0096b4c9a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.045708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-257cd0db-74f5-48a0-83ee-49b0096b4c9a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.047834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-257cd0db-74f5-48a0-83ee-49b0096b4c9a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.049028 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-257cd0db-74f5-48a0-83ee-49b0096b4c9a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1280 microversion: 2.20 time: 0.131685 Jul 18 14:21:50.049583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 516/1007] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:49 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1280 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:51.067757 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:51.068400 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:51.074578 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.075034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.075819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.076282 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.140122 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.149749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.151247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.152363 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ca68ca73-7804-4c1f-9888-ed6db3636938 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1284 microversion: 2.20 time: 0.088513 Jul 18 14:21:51.152939 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 492/1008] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:51 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:52.169781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:52.170417 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:52.177175 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.177625 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.178399 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.178831 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.272781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.280712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.282872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.283986 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4e769c0b-c20f-475d-acfa-d0568fb14c07 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1338 microversion: 2.20 time: 0.118097 Jul 18 14:21:52.284542 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 517/1009] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:52 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1338 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:53.104668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-4417bf16-482b-4132-a9dc-36a5310b4019 req-84373e2f-84e5-44cb-bdd4-b82bc0dbe4ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b11b52-344f-40fa-9223-bde705aedfc9", "tag": "43f446cc-b2f0-4389-ba66-647b952de4e8"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:53.119330 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4417bf16-482b-4132-a9dc-36a5310b4019 req-84373e2f-84e5-44cb-bdd4-b82bc0dbe4ae service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.119815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-4417bf16-482b-4132-a9dc-36a5310b4019 req-84373e2f-84e5-44cb-bdd4-b82bc0dbe4ae service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.137193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-4417bf16-482b-4132-a9dc-36a5310b4019 req-84373e2f-84e5-44cb-bdd4-b82bc0dbe4ae service nova] Creating event network-changed:43f446cc-b2f0-4389-ba66-647b952de4e8 for instance 51b11b52-344f-40fa-9223-bde705aedfc9 on hv-cinder-84984 Jul 18 14:21:53.143508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-4417bf16-482b-4132-a9dc-36a5310b4019 req-84373e2f-84e5-44cb-bdd4-b82bc0dbe4ae service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043676 Jul 18 14:21:53.144130 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 493/1010] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:53.302037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:53.302646 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:53.309289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.309735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.310503 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.310940 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.508677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:53.516446 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:53.517938 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:53.519033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-adb9d358-59ee-45c1-8a23-d68e4be2bd8c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1406 microversion: 2.20 time: 0.220915 Jul 18 14:21:53.519594 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 518/1011] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:53 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:54.537475 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:54.538171 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:54.544820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.545271 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.546029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.546469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.679770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.687990 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.689527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.690621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ff23b597-2677-4e25-801f-bdd5d66264f7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1406 microversion: 2.20 time: 0.157412 Jul 18 14:21:54.691172 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 494/1012] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:54 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:55.709193 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:55.709791 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:55.712281 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:55.717802 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.718247 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.719004 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.719438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.851565 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.859435 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.861521 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.862616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-914b1849-84fe-4332-93b9-9f1d68c7eb31 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1406 microversion: 2.20 time: 0.157338 Jul 18 14:21:55.863172 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 519/1013] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:55 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:56.881069 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:56.881683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:56.888264 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.888715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.889481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.889922 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:57.023265 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:57.031204 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:57.032782 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:57.033893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f1b8726c-f320-4640-ae43-7a1686c67b61 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1406 microversion: 2.20 time: 0.156737 Jul 18 14:21:57.034445 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 495/1014] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:56 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:58.052041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:58.052577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:58.059212 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.059650 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.060431 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.060859 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.189029 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.196889 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.198365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.199497 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-338105c4-80e0-4052-b5f9-5212175da47e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1406 microversion: 2.20 time: 0.151378 Jul 18 14:21:58.200073 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 520/1015] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:58 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:59.055668 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-1ee29714-2e90-4a2d-beaa-f75defd268ae req-6f1aa374-e284-43d0-99f2-25ba2d64d80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b11b52-344f-40fa-9223-bde705aedfc9", "name": "network-vif-plugged", "status": "completed", "tag": "43f446cc-b2f0-4389-ba66-647b952de4e8"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:59.060092 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=8 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:59.066663 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-1ee29714-2e90-4a2d-beaa-f75defd268ae req-6f1aa374-e284-43d0-99f2-25ba2d64d80e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.067034 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-1ee29714-2e90-4a2d-beaa-f75defd268ae req-6f1aa374-e284-43d0-99f2-25ba2d64d80e service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.077837 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-1ee29714-2e90-4a2d-beaa-f75defd268ae req-6f1aa374-e284-43d0-99f2-25ba2d64d80e service nova] Creating event network-vif-plugged:43f446cc-b2f0-4389-ba66-647b952de4e8 for instance 51b11b52-344f-40fa-9223-bde705aedfc9 on hv-cinder-84984 Jul 18 14:21:59.083157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-1ee29714-2e90-4a2d-beaa-f75defd268ae req-6f1aa374-e284-43d0-99f2-25ba2d64d80e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031263 Jul 18 14:21:59.083721 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 496/1016] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:59.217877 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:59.218488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:59.224925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.225457 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.226952 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.227577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.406263 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:59.414081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:59.415561 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:59.416670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3100b568-ef26-4750-be91-81191a392660 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1406 microversion: 2.20 time: 0.203096 Jul 18 14:21:59.417222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 521/1017] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:59 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:00.435630 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:00.436362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:00.442667 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.443119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:00.443881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.444339 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:00.574311 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.582600 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.584143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.585241 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cdcf9c6c-dc2b-4555-bd6f-d0c265107e6d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1406 microversion: 2.20 time: 0.154663 Jul 18 14:22:00.585789 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 497/1018] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:00 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:01.603469 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:01.604097 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:01.605910 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=10 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:01.611552 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.612019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.612770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.613195 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.738740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:01.746469 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:01.748039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:01.749146 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3e1ae20d-54ad-40b5-a4c1-42953edd4efb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1598 microversion: 2.20 time: 0.149629 Jul 18 14:22:01.749710 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 522/1019] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:01 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:22:01.766618 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-d7655cdf-217f-47b9-8888-9faeb4cafd64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:01.767121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-d7655cdf-217f-47b9-8888-9faeb4cafd64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:01.773416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7655cdf-217f-47b9-8888-9faeb4cafd64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.773854 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7655cdf-217f-47b9-8888-9faeb4cafd64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.774600 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7655cdf-217f-47b9-8888-9faeb4cafd64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.775025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-d7655cdf-217f-47b9-8888-9faeb4cafd64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.853447 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-d7655cdf-217f-47b9-8888-9faeb4cafd64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090536 Jul 18 14:22:01.854027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 498/1020] 10.222.0.94 () {60 vars in 1315 bytes} [Mon Jul 18 14:22:01 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:22:03.033032 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-e40d4581-2ba8-4f85-8293-d2741286d848 req-835f804f-8caa-4299-8332-83e80bef7e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b11b52-344f-40fa-9223-bde705aedfc9", "tag": "43f446cc-b2f0-4389-ba66-647b952de4e8"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:03.041737 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-e40d4581-2ba8-4f85-8293-d2741286d848 req-835f804f-8caa-4299-8332-83e80bef7e2f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:03.042178 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-e40d4581-2ba8-4f85-8293-d2741286d848 req-835f804f-8caa-4299-8332-83e80bef7e2f service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:03.053715 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-e40d4581-2ba8-4f85-8293-d2741286d848 req-835f804f-8caa-4299-8332-83e80bef7e2f service nova] Creating event network-changed:43f446cc-b2f0-4389-ba66-647b952de4e8 for instance 51b11b52-344f-40fa-9223-bde705aedfc9 on hv-cinder-84984 Jul 18 14:22:03.058735 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-e40d4581-2ba8-4f85-8293-d2741286d848 req-835f804f-8caa-4299-8332-83e80bef7e2f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029813 Jul 18 14:22:03.059601 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 523/1021] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:18.148058 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:18.148805 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:18.153882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ffbe5380-da6e-4b47-82cf-b5539c01a0cf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:18.154370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ffbe5380-da6e-4b47-82cf-b5539c01a0cf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:18.162429 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ffbe5380-da6e-4b47-82cf-b5539c01a0cf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.162881 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ffbe5380-da6e-4b47-82cf-b5539c01a0cf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:18.163640 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ffbe5380-da6e-4b47-82cf-b5539c01a0cf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.164172 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ffbe5380-da6e-4b47-82cf-b5539c01a0cf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:18.187870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ffbe5380-da6e-4b47-82cf-b5539c01a0cf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/ips" status: 200 len: 151 microversion: 2.20 time: 0.041839 Jul 18 14:23:18.188453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 499/1022] 10.222.0.94 () {60 vars in 1288 bytes} [Mon Jul 18 14:23:18 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:23:19.999664 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:20.000443 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:20.004865 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:20.005452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:20.014724 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.015205 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:20.015972 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.016388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:20.038392 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lazy-loading 'flavor' on Instance uuid 51b11b52-344f-40fa-9223-bde705aedfc9 {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:23:20.287651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0d15de4f-ecef-4c71-bbbb-22001478b218 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/action" status: 202 len: 0 microversion: 2.20 time: 0.289812 Jul 18 14:23:20.288311 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 524/1023] 10.222.0.94 () {62 vars in 1318 bytes} [Mon Jul 18 14:23:19 2022] POST /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:23:20.296843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:20.298045 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:20.304594 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.305029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:20.305821 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.306812 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:20.435236 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:20.443272 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:20.444778 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:20.445904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-212cc1fd-68f0-4c7b-83cd-ba3cddb2ed2c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.152967 Jul 18 14:23:20.446488 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 500/1024] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:20 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:21.465144 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:21.465858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:21.472056 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.472500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.473259 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.473748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.650500 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:21.658558 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:21.660063 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:21.661206 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b2a5f6ab-2dbc-4252-87d3-ff0f3b93f016 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.200958 Jul 18 14:23:21.661758 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 525/1025] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:21 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:21.781297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:21.782390 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:21.783883 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-d30acafd-16e2-44ff-a708-9c2bcf9c25ca req-52feb5dc-a249-41ef-9920-181cb10c1f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0138d3-545d-4df1-b0aa-33c45c4b7411", "tag": "b1bd83de-a793-4dd0-8ba1-4d29f43fbf51"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:21.789163 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.789712 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.791041 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.791539 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.794142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-d30acafd-16e2-44ff-a708-9c2bcf9c25ca req-52feb5dc-a249-41ef-9920-181cb10c1f16 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.794585 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-d30acafd-16e2-44ff-a708-9c2bcf9c25ca req-52feb5dc-a249-41ef-9920-181cb10c1f16 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.807045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-d30acafd-16e2-44ff-a708-9c2bcf9c25ca req-52feb5dc-a249-41ef-9920-181cb10c1f16 service nova] Creating event network-changed:b1bd83de-a793-4dd0-8ba1-4d29f43fbf51 for instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 on hv-cinder-84984 Jul 18 14:23:21.812707 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-d30acafd-16e2-44ff-a708-9c2bcf9c25ca req-52feb5dc-a249-41ef-9920-181cb10c1f16 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Jul 18 14:23:21.813499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 526/1026] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:23:21.819518 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:23:21.912204 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-37357028-4719-4880-8502-579460f2c81e tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "DELETE /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 204 len: 0 microversion: 2.1 time: 0.134600 Jul 18 14:23:21.916022 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 501/1027] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:23:21 2022] DELETE /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:23:21.923414 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:21.925147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:21.932280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.932732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.933537 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.933970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.099915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:22.107790 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-80a28375-2cd2-4a93-b06e-d2371efe4695 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1577 microversion: 2.1 time: 0.190437 Jul 18 14:23:22.116253 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 527/1028] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:21 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:22.679796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:22.680518 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:22.686569 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:22.687013 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.687778 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:22.688233 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.819063 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:22.827710 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:22.829247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:22.830400 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ff34a100-0110-41ab-be56-db062c0e07f9 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.154975 Jul 18 14:23:22.830951 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 502/1029] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:22 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:23.125572 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:23.126169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:23.132340 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.132781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:23.133532 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.133956 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:23.339678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:23.347179 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-686086c3-38cb-4099-be60-87043732660c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1577 microversion: 2.1 time: 0.225488 Jul 18 14:23:23.347744 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 528/1030] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:23 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:23.848984 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:23.849699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:23.856425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.856868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:23.857629 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.858066 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:24.069000 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:24.078024 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:24.079504 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:24.080695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e5011c79-55f2-4335-9fca-899ef4b2f766 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.236061 Jul 18 14:23:24.081245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 503/1031] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:23 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:24.366700 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:24.367310 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:24.374570 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:24.375011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:24.375798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:24.376262 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:24.656687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:24.668660 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ecdfb31d-5851-44fe-a08c-8ef07d94f990 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 200 len: 1390 microversion: 2.1 time: 0.305807 Jul 18 14:23:24.671866 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 529/1032] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:24 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 1390 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:24.672164 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-681de6f2-dc48-4c47-b502-6e2e21f51ad9 req-26021b81-87d6-4c80-8888-cfe2274aa1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0138d3-545d-4df1-b0aa-33c45c4b7411", "name": "network-vif-deleted", "tag": "b1bd83de-a793-4dd0-8ba1-4d29f43fbf51"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:24.679696 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-681de6f2-dc48-4c47-b502-6e2e21f51ad9 req-26021b81-87d6-4c80-8888-cfe2274aa1a8 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:24.680882 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-681de6f2-dc48-4c47-b502-6e2e21f51ad9 req-26021b81-87d6-4c80-8888-cfe2274aa1a8 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:24.693946 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-681de6f2-dc48-4c47-b502-6e2e21f51ad9 req-26021b81-87d6-4c80-8888-cfe2274aa1a8 service nova] Creating event network-vif-deleted:b1bd83de-a793-4dd0-8ba1-4d29f43fbf51 for instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 on hv-cinder-84984 Jul 18 14:23:24.698727 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-681de6f2-dc48-4c47-b502-6e2e21f51ad9 req-26021b81-87d6-4c80-8888-cfe2274aa1a8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033867 Jul 18 14:23:24.699645 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 504/1033] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:25.099634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:25.100280 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:25.117048 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:25.117486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:25.118265 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:25.118742 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:25.256908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:25.264676 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:25.266155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:25.267285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-5dd0a31d-e958-4739-b402-3435f3407347 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.171638 Jul 18 14:23:25.267832 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 530/1034] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:25 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:25.686667 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:25.687366 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 6b0138d3-545d-4df1-b0aa-33c45c4b7411] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:25.693762 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:25.694209 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:25.694975 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:25.695411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:25.708868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] HTTP exception thrown: Instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 could not be found. Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Request method failure captured: Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 HTTP/1.1 Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wq8JID3LOqvscPv-Dv3MDT7dH6rIf6JCfaxvsRfh9rbKnGvd_B0sK5QDYmASWHIaU4E_MtHmfY7W-lYMdMfzAMto0tzEdggBAdIiHRFtRxiQMFWYikfLRb2Eww-g70Txp2AB1DGZrSa3rbR0qWyvOOSOEHT4zIRUQl1FpgT9DFVPUs Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:23:25.710462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9df5aea1d29c4a91b82a956e152bd214"}]}] Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 35334a0f92254b5e900aad8c51873809 Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 could not be found. Jul 18 14:23:25.712861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '6b0138d3-545d-4df1-b0aa-33c45c4b7411'} Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 could not be found. Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:23:25.713914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 could not be found. Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 could not be found. Jul 18 14:23:25.715465 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:25.717057 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Returning 404 to user: Instance 6b0138d3-545d-4df1-b0aa-33c45c4b7411 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:23:25.717057 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c96377f6-38a0-46d4-be0f-d6d96a545bc5 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411" status: 404 len: 111 microversion: 2.1 time: 0.029821 Jul 18 14:23:25.717057 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 505/1035] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:25 2022] GET /compute/v2.1/servers/6b0138d3-545d-4df1-b0aa-33c45c4b7411 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:23:26.285742 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:26.286351 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:26.293333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.293784 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.294549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.294979 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.421333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:26.429142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:26.430643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:26.432447 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c3568f49-f5a7-4d60-9f4a-05eaec29553a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.150656 Jul 18 14:23:26.433011 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 531/1036] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:26 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:27.451227 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:27.451872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:27.458225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:27.458672 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:27.459433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:27.459868 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:27.586514 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:27.594445 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:27.595958 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:27.597104 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-544debec-ae55-42e7-bc04-0f782663beda tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.150424 Jul 18 14:23:27.597656 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 506/1037] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:27 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:28.615727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:28.616377 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:28.622718 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:28.623162 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.623925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:28.624384 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.807730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:28.808806 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:28.816121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:28.816876 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.817844 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:28.818453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.828125 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:28.836499 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:28.838050 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:28.839516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1990eb78-055c-4d53-b9ee-56ebfe832437 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.227825 Jul 18 14:23:28.840108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 532/1038] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:28 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:28.845173 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-07577a49-6277-47b3-987a-aa3de1fa77bc req-bc4efc51-3896-4aae-b243-c0bc99169c75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8", "tag": "7f708601-2664-4499-b22f-8cc585709539"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:28.849464 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:23:28.854271 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-07577a49-6277-47b3-987a-aa3de1fa77bc req-bc4efc51-3896-4aae-b243-c0bc99169c75 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:28.854714 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-07577a49-6277-47b3-987a-aa3de1fa77bc req-bc4efc51-3896-4aae-b243-c0bc99169c75 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.866544 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-07577a49-6277-47b3-987a-aa3de1fa77bc req-bc4efc51-3896-4aae-b243-c0bc99169c75 service nova] Creating event network-changed:7f708601-2664-4499-b22f-8cc585709539 for instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 on hv-cinder-84984 Jul 18 14:23:28.872486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-07577a49-6277-47b3-987a-aa3de1fa77bc req-bc4efc51-3896-4aae-b243-c0bc99169c75 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030695 Jul 18 14:23:28.873282 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 533/1039] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:28.934710 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b7e9e92-0df4-4761-8d19-18fd81dd7ff2 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "DELETE /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 204 len: 0 microversion: 2.1 time: 0.130560 Jul 18 14:23:28.935671 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 507/1040] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:23:28 2022] DELETE /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:23:28.950745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:28.951029 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:28.957527 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:28.957980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.958763 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:28.959195 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:29.098545 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:29.106592 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-99b0a74b-d3d4-4572-a27d-5267db786762 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1576 microversion: 2.1 time: 0.162289 Jul 18 14:23:29.107159 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 534/1041] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:28 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:29.858507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:29.859211 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:29.866299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:29.866991 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:29.867771 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:29.868271 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.084166 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:30.092692 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:30.094197 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:30.095362 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f527bd30-f217-420c-aca6-6cc35c621c8b tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.241158 Jul 18 14:23:30.095916 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 508/1042] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:29 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:30.123536 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:30.124178 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:30.130797 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:30.131250 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.132046 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:30.132508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.329557 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:30.337201 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-facfeacd-05d2-404b-958a-256964a96088 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1457 microversion: 2.1 time: 0.217496 Jul 18 14:23:30.337908 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 535/1043] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:30 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1457 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:30.888359 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-7cf77c28-8494-4ac0-8de4-54fa2bdc820b req-a3048a99-3f83-4995-b4be-74d5172163dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8", "name": "network-vif-deleted", "tag": "7f708601-2664-4499-b22f-8cc585709539"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:30.898412 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-7cf77c28-8494-4ac0-8de4-54fa2bdc820b req-a3048a99-3f83-4995-b4be-74d5172163dc service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:30.898905 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-7cf77c28-8494-4ac0-8de4-54fa2bdc820b req-a3048a99-3f83-4995-b4be-74d5172163dc service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.910223 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-7cf77c28-8494-4ac0-8de4-54fa2bdc820b req-a3048a99-3f83-4995-b4be-74d5172163dc service nova] Creating event network-vif-deleted:7f708601-2664-4499-b22f-8cc585709539 for instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 on hv-cinder-84984 Jul 18 14:23:30.914776 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-7cf77c28-8494-4ac0-8de4-54fa2bdc820b req-a3048a99-3f83-4995-b4be-74d5172163dc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030212 Jul 18 14:23:30.915356 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 509/1044] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:31.112808 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:31.113335 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:31.119312 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.119756 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.120557 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.120991 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.248453 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:31.257086 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:31.258575 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:31.259772 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-95a50989-3b6f-436e-92a5-a48e632f8f55 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.150926 Jul 18 14:23:31.260358 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 536/1045] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:31 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:31.354607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:31.355297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:31.361456 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.361893 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.362639 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.363113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.392195 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.392628 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.393068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lazy-loading 'fault' on Instance uuid da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:23:31.436737 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35334a0f92254b5e900aad8c51873809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5aea1d29c4a91b82a956e152bd214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:31.444601 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c368b5dd-4911-4346-b52f-d98f47cac89d tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 200 len: 1229 microversion: 2.1 time: 0.094344 Jul 18 14:23:31.445147 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 510/1046] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:31 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:32.277916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:32.278519 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:32.285045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.285492 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.286251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.286681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.417099 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:32.424961 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:32.426455 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:32.427625 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dac32764-1f66-43a2-81f3-c2e7bda7683f tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1743 microversion: 2.20 time: 0.153610 Jul 18 14:23:32.428211 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 537/1047] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:32 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:32.462119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:32.463253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:32.469744 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.470175 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.470938 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.471374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.484915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] HTTP exception thrown: Instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 could not be found. Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Request method failure captured: Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 HTTP/1.1 Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wq8JID3LOqvscPv-Dv3MDT7dH6rIf6JCfaxvsRfh9rbKnGvd_B0sK5QDYmASWHIaU4E_MtHmfY7W-lYMdMfzAMto0tzEdggBAdIiHRFtRxiQMFWYikfLRb2Eww-g70Txp2AB1DGZrSa3rbR0qWyvOOSOEHT4zIRUQl1FpgT9DFVPUs Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:23:32.486520 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9df5aea1d29c4a91b82a956e152bd214"}]}] Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 35334a0f92254b5e900aad8c51873809 Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 could not be found. Jul 18 14:23:32.488275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8'} Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 could not be found. Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:23:32.489770 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 could not be found. Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 could not be found. Jul 18 14:23:32.491513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.493704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Returning 404 to user: Instance da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:23:32.493704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c2d6ad8f-1e9e-43fb-b67c-d5f4fa444a6c tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8" status: 404 len: 111 microversion: 2.1 time: 0.029735 Jul 18 14:23:32.493704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 511/1048] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:32 2022] GET /compute/v2.1/servers/da7cf9af-38ab-4310-8cdf-c9b5ff41d9e8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:23:32.916781 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:32.917279 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:32.923289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.923738 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.924643 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.925079 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.938298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] HTTP exception thrown: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Request method failure captured: Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: DELETE /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 HTTP/1.1 Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1Wq8JID3LOqvscPv-Dv3MDT7dH6rIf6JCfaxvsRfh9rbKnGvd_B0sK5QDYmASWHIaU4E_MtHmfY7W-lYMdMfzAMto0tzEdggBAdIiHRFtRxiQMFWYikfLRb2Eww-g70Txp2AB1DGZrSa3rbR0qWyvOOSOEHT4zIRUQl1FpgT9DFVPUs Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:23:32.939891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9df5aea1d29c4a91b82a956e152bd214"}]}] Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 35334a0f92254b5e900aad8c51873809 Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.941778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '5f5b2707-4b87-4dbd-b986-13ec52ee0f47'} Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:23:32.942640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.944164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.945673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Returning 404 to user: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:23:32.945673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-838f0091-6691-4986-a6e4-97f5e4805973 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "DELETE /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 404 len: 111 microversion: 2.1 time: 0.028707 Jul 18 14:23:32.945673 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 538/1049] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:23:32 2022] DELETE /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:23:32.951205 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:32.951819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] [instance: 5f5b2707-4b87-4dbd-b986-13ec52ee0f47] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:32.958005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.958487 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.959252 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.959688 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.973579 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] HTTP exception thrown: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Request method failure captured: Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 HTTP/1.1 Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1Wq8JID3LOqvscPv-Dv3MDT7dH6rIf6JCfaxvsRfh9rbKnGvd_B0sK5QDYmASWHIaU4E_MtHmfY7W-lYMdMfzAMto0tzEdggBAdIiHRFtRxiQMFWYikfLRb2Eww-g70Txp2AB1DGZrSa3rbR0qWyvOOSOEHT4zIRUQl1FpgT9DFVPUs Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:23:32.975073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/9df5aea1d29c4a91b82a956e152bd214"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_9df5aea1d29c4a91b82a956e152bd214"}]}] Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 9df5aea1d29c4a91b82a956e152bd214 Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestVolumeBootPattern-1696944733 Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 35334a0f92254b5e900aad8c51873809 Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestVolumeBootPattern-1696944733-project Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.976733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '5f5b2707-4b87-4dbd-b986-13ec52ee0f47'} Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:23:32.977818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. Jul 18 14:23:32.979397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:23:32.981008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Returning 404 to user: Instance 5f5b2707-4b87-4dbd-b986-13ec52ee0f47 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:23:32.981008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-c1075468-b14c-4caf-809c-de959eaf7258 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47" status: 404 len: 111 microversion: 2.1 time: 0.029873 Jul 18 14:23:32.981008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 512/1050] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:32 2022] GET /compute/v2.1/servers/5f5b2707-4b87-4dbd-b986-13ec52ee0f47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:23:33.446151 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:33.446761 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:33.453855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:33.454306 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:33.455080 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:33.455510 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:33.590148 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:33.598006 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:33.599486 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:33.600685 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f63ff065-44e7-48d4-9ccd-148bd32101be tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1743 microversion: 2.20 time: 0.158488 Jul 18 14:23:33.601233 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 539/1051] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:33 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:34.265349 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ae3cfc17-f3cb-4afd-bcbe-d63a36181943 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] Calling method '.version_select at 0x7f7b3b29d8b0>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:34.283430 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ae3cfc17-f3cb-4afd-bcbe-d63a36181943 tempest-TestVolumeBootPattern-1696944733 tempest-TestVolumeBootPattern-1696944733-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-843152289" status: 202 len: 0 microversion: 2.1 time: 0.022133 Jul 18 14:23:34.284021 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 513/1052] 10.222.0.94 () {58 vars in 1259 bytes} [Mon Jul 18 14:23:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-843152289 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:23:34.618727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:34.619974 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:34.626361 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:34.626878 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:34.627634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:34.628087 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:34.645693 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:35.139966 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:35.147898 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:35.149414 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:35.151241 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a98edae6-78ca-44cb-9849-51b6d53f8730 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1743 microversion: 2.20 time: 0.536492 Jul 18 14:23:35.151785 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 540/1053] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:34 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1743 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:35.451112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-e310b7ef-a3c4-45cd-9ee4-2b0bcbce4db1 req-52da348b-96f5-46fc-9e78-54c74d3d9880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b11b52-344f-40fa-9223-bde705aedfc9", "name": "network-vif-plugged", "status": "completed", "tag": "43f446cc-b2f0-4389-ba66-647b952de4e8"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:35.463421 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e310b7ef-a3c4-45cd-9ee4-2b0bcbce4db1 req-52da348b-96f5-46fc-9e78-54c74d3d9880 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:35.464302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-e310b7ef-a3c4-45cd-9ee4-2b0bcbce4db1 req-52da348b-96f5-46fc-9e78-54c74d3d9880 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:35.476702 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-e310b7ef-a3c4-45cd-9ee4-2b0bcbce4db1 req-52da348b-96f5-46fc-9e78-54c74d3d9880 service nova] Creating event network-vif-plugged:43f446cc-b2f0-4389-ba66-647b952de4e8 for instance 51b11b52-344f-40fa-9223-bde705aedfc9 on hv-cinder-84984 Jul 18 14:23:35.483732 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-e310b7ef-a3c4-45cd-9ee4-2b0bcbce4db1 req-52da348b-96f5-46fc-9e78-54c74d3d9880 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Jul 18 14:23:35.485232 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 514/1054] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:36.170369 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:36.171637 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:36.178501 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:36.179044 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:36.179901 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:36.180436 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:36.387256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:36.399504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:36.401807 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:36.403736 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a8461b6e-fe95-42fd-9165-b346e4c32fc3 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.237938 Jul 18 14:23:36.416256 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 541/1055] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:36 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:37.423481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:37.424802 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:37.439842 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:37.440761 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:37.441716 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:37.445699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:37.747682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:37.758909 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:37.762661 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:37.769527 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-383d6b5b-fcb9-4495-82f4-3a1d9b61fedf tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.346916 Jul 18 14:23:37.770798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 515/1056] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:37 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:38.793517 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:38.794870 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:38.802352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:38.803030 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:38.803819 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:38.804360 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:39.035258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:39.044970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:39.047056 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:39.048578 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a48b4cb8-1e90-4889-b640-5b6083b24c51 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.261220 Jul 18 14:23:39.057353 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 542/1057] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:38 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:40.067411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:40.068703 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:40.086928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.087471 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.088398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.088894 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.403037 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:40.418468 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:40.420364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:40.421750 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f7ba3d0e-9f44-40a0-ae6d-6d4e38f554eb tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.358754 Jul 18 14:23:40.435701 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 516/1058] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:40 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:41.442824 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:41.443489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:41.450258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:41.450649 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:41.451449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:41.451894 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:41.713128 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:41.723869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:41.726445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:41.727891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0950f418-e7df-4c43-8da8-e3aa99f15b33 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.289193 Jul 18 14:23:41.729339 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 543/1059] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:41 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:42.747478 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:42.748153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:42.756612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:42.757405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:42.758891 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:42.759608 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:42.764872 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:42.914644 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:42.926950 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:42.928918 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:42.930436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-bd743d7d-7a21-4be0-a3b1-f486e3a600aa tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.187625 Jul 18 14:23:42.930974 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 517/1060] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:42 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:43.173542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:23:43.174025 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:23:43.833212 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:23:43.833770 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Mon Jul 18 14:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:23:43.957608 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:43.958223 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:43.965799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:43.966245 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:43.967017 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:43.967445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:44.122678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:44.131182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:44.132711 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:44.133868 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e76dc028-b9ff-45d6-b192-5da562a6cbe6 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.182855 Jul 18 14:23:44.147154 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 544/1061] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:43 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:45.153551 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:45.154748 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:45.161225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:45.161683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:45.162444 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:45.162880 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:45.323654 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:45.332002 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:45.333658 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:45.334952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-a6d15f88-0c41-4585-87dd-b13f728026a8 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.185242 Jul 18 14:23:45.335596 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 518/1062] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:45 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:46.354397 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:46.355001 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:46.361380 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:46.362090 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:46.363094 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:46.363727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:46.504578 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:46.512523 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:46.514388 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:46.516272 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0a7c0ecb-83aa-440f-a2ef-a068b2270977 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1738 microversion: 2.20 time: 0.166076 Jul 18 14:23:46.517093 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 545/1063] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:46 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:47.534695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:47.535305 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:47.542271 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:47.542718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:47.543487 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:47.543919 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:47.758981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:47.766768 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:47.768283 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:47.769425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b7a96321-38f7-4c4e-b75e-2b437f4b82a4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1720 microversion: 2.20 time: 0.238770 Jul 18 14:23:47.769981 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 519/1064] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:47 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:48.791299 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:48.792439 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:48.800075 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:48.800524 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:48.801296 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:48.801732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:48.942902 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:48.950813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:48.952322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:48.953463 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-60227766-6d10-49e4-be72-e3ed3ede60d7 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1720 microversion: 2.20 time: 0.168926 Jul 18 14:23:48.954000 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 546/1065] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:48 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:49.972468 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:49.973084 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:49.975405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:49.981864 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:49.982486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:49.983256 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:49.983695 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.114689 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:50.123887 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:50.125418 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:50.126596 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-0050dcc2-88fa-4c19-b061-ced31d8a03ee tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1723 microversion: 2.20 time: 0.158025 Jul 18 14:23:50.127143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 520/1066] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:49 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:23:50.144142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e798aee4-0b9c-4809-b84a-7c79d78ef12c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cf7bcb9-b2ab-4037-8d70-4cd2133574ab"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:50.145982 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e798aee4-0b9c-4809-b84a-7c79d78ef12c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:50.148337 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=47 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:50.153895 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e798aee4-0b9c-4809-b84a-7c79d78ef12c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.154335 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e798aee4-0b9c-4809-b84a-7c79d78ef12c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.155095 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e798aee4-0b9c-4809-b84a-7c79d78ef12c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.155520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e798aee4-0b9c-4809-b84a-7c79d78ef12c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.432326 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e798aee4-0b9c-4809-b84a-7c79d78ef12c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291625 Jul 18 14:23:50.432917 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 547/1067] 10.222.0.94 () {62 vars in 1363 bytes} [Mon Jul 18 14:23:50 2022] POST /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:23:50.544442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2e7b805e-57ff-4516-95b5-1229111be311 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:50.544934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2e7b805e-57ff-4516-95b5-1229111be311 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:50.550833 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e7b805e-57ff-4516-95b5-1229111be311 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.551281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e7b805e-57ff-4516-95b5-1229111be311 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.552067 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e7b805e-57ff-4516-95b5-1229111be311 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.552500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2e7b805e-57ff-4516-95b5-1229111be311 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.781626 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2e7b805e-57ff-4516-95b5-1229111be311 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-volume_attachments/0cf7bcb9-b2ab-4037-8d70-4cd2133574ab" status: 202 len: 0 microversion: 2.20 time: 0.241450 Jul 18 14:23:50.782219 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 521/1068] 10.222.0.94 () {60 vars in 1456 bytes} [Mon Jul 18 14:23:50 2022] DELETE /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-volume_attachments/0cf7bcb9-b2ab-4037-8d70-4cd2133574ab => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:23:50.839039 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-255f275b-a8d4-4095-9de6-d6cfd764a618 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:50.839546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-255f275b-a8d4-4095-9de6-d6cfd764a618 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:50.846840 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-255f275b-a8d4-4095-9de6-d6cfd764a618 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.847289 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-255f275b-a8d4-4095-9de6-d6cfd764a618 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.848083 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-255f275b-a8d4-4095-9de6-d6cfd764a618 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.848523 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-255f275b-a8d4-4095-9de6-d6cfd764a618 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.925539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-255f275b-a8d4-4095-9de6-d6cfd764a618 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "POST /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/action" status: 202 len: 0 microversion: 2.20 time: 0.091155 Jul 18 14:23:50.927033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 548/1069] 10.222.0.94 () {62 vars in 1318 bytes} [Mon Jul 18 14:23:50 2022] POST /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:23:50.936457 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:50.937365 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:50.945011 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.945466 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.946250 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.946689 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:51.116899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:51.126299 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:51.127811 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:51.128992 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-db4ecbfb-356d-4887-b429-7c0ca0e2a051 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1671 microversion: 2.20 time: 0.196674 Jul 18 14:23:51.129544 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 522/1070] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:50 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1671 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:51.494658 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-f37e1654-05eb-48dd-a1dc-6defaa497863 req-8dd0d1e2-45c4-40c7-9532-9bb1b3eab010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b11b52-344f-40fa-9223-bde705aedfc9", "name": "network-vif-unplugged", "status": "completed", "tag": "43f446cc-b2f0-4389-ba66-647b952de4e8"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:51.505298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-f37e1654-05eb-48dd-a1dc-6defaa497863 req-8dd0d1e2-45c4-40c7-9532-9bb1b3eab010 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:51.505906 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-f37e1654-05eb-48dd-a1dc-6defaa497863 req-8dd0d1e2-45c4-40c7-9532-9bb1b3eab010 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:51.518571 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.compute.server_external_events [req-f37e1654-05eb-48dd-a1dc-6defaa497863 req-8dd0d1e2-45c4-40c7-9532-9bb1b3eab010 service nova] Unable to find a host for instance 51b11b52-344f-40fa-9223-bde705aedfc9. Dropping event network-vif-unplugged {{(pid=117845) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 14:23:51.519687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-f37e1654-05eb-48dd-a1dc-6defaa497863 req-8dd0d1e2-45c4-40c7-9532-9bb1b3eab010 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031031 Jul 18 14:23:51.520609 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 549/1071] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 14:23:52.148350 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:52.148956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:52.155904 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:52.156317 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:52.157068 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:52.157500 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:52.289477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:52.298683 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:52.300280 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:52.301419 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-3ea42e98-ffd4-4ee5-868e-9c84e3b0edca tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.156980 Jul 18 14:23:52.301969 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 523/1072] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:52 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:53.320274 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:53.321857 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:53.330164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:53.331058 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:53.332605 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:53.333273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:53.539356 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:53.560370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:53.566013 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:53.570426 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9de7719a-46ff-4935-ae9e-85cdd8f3f08d tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.253453 Jul 18 14:23:53.574186 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 550/1073] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:53 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:54.591220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:54.591813 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:54.598471 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.598921 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.599682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.600261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.746690 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:54.754618 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:54.756263 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:54.757382 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-90b40c08-967f-4709-9cf9-8153f9f74ff5 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.170093 Jul 18 14:23:54.757934 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 524/1074] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:54 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:55.775539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:55.776296 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:55.782677 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:55.783118 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:55.783882 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:55.784357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:55.946520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:55.959975 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:55.961678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:55.964329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f8e78b24-f44a-4f59-a86e-d10b57544519 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.191285 Jul 18 14:23:55.974265 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 551/1075] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:55 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:56.982425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:56.983089 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:56.991210 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:56.991743 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:56.992612 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:56.993080 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:57.153772 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:57.162604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:57.164168 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:57.165469 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-030213b2-6406-4c8f-8035-5632e4401784 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.187742 Jul 18 14:23:57.172732 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 525/1076] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:56 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:58.184678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:58.185350 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:58.192191 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:58.192638 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:58.193401 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:58.193829 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:58.347821 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:58.355858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:58.357596 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:58.358748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0f4905e6-4d96-4941-ae0a-e50f26dafbde tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.178232 Jul 18 14:23:58.359298 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 552/1077] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:58 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:59.380652 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:59.382347 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:59.394851 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:59.395855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:59.397409 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:59.398302 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:59.557111 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:59.567114 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:59.568681 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:59.569921 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e8768851-6ebc-4aef-a0d6-aed9e57b617e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.195738 Jul 18 14:23:59.570468 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 526/1078] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:59 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:00.588428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:00.588986 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:00.595641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:00.596131 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:00.596940 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:00.597418 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:00.763701 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:00.772503 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:00.773996 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:00.775138 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-e11c2fed-952d-4593-883f-d509a2f7a629 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.190814 Jul 18 14:24:00.775695 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 553/1079] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:00 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:01.794501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:01.795138 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:01.803145 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:01.803534 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:01.804326 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:01.804766 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:01.952009 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:01.960418 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:01.961915 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:01.963066 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ed611af7-0d7f-4969-9646-45c7127360a1 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.173206 Jul 18 14:24:01.963627 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 527/1080] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:01 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:02.986005 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:02.986616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:02.993339 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.993789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.995143 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.995578 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.999566 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:03.127016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:03.135023 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:03.136471 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:03.137610 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8b066e32-1268-448d-814a-06a12bfdc1b4 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.156365 Jul 18 14:24:03.138164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 554/1081] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:02 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:04.156214 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:04.156827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:04.163499 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:04.163933 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:04.164730 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:04.165166 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:04.295709 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:04.304094 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:04.305607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:04.306796 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-066221fe-9e57-48e9-8823-4f2cf41df929 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.154531 Jul 18 14:24:04.307348 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 528/1082] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:04 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:05.324819 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:05.325355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:05.331789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.332412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.333180 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.333623 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.460669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:05.469007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:05.470512 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:05.471662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-54f17664-d2c6-49fe-8e08-0fb57b8a8a19 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.150826 Jul 18 14:24:05.472248 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 555/1083] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:05 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:06.490404 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.491040 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.497522 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.497969 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.498722 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.499153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.626645 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:06.634694 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:06.636724 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:06.637907 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-76788290-17e1-446f-9928-14b2928eb381 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.151348 Jul 18 14:24:06.638614 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 529/1084] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:06 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:07.657241 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:07.657861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:07.664452 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:07.664899 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:07.665661 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:07.666142 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:07.792963 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:07.801098 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:07.802595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:07.803745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6d371e10-7b2f-47b9-bd0d-8cd3ec577a64 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.150392 Jul 18 14:24:07.804324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 556/1085] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:07 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:24:08.822943 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:08.823483 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:08.830021 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.830477 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.831243 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.831675 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.959314 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:08.967766 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:08.969275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:08.970405 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-19e8bb9c-1fb3-4ebd-bbbe-e0a966110d89 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.151973 Jul 18 14:24:08.970952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 530/1086] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:08 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:09.574433 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-0775a807-75ab-4917-a4d2-90969cf72fff req-10146c28-0a74-4712-97d6-f4e168da2e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b11b52-344f-40fa-9223-bde705aedfc9", "name": "network-vif-plugged", "status": "completed", "tag": "43f446cc-b2f0-4389-ba66-647b952de4e8"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:09.583634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-0775a807-75ab-4917-a4d2-90969cf72fff req-10146c28-0a74-4712-97d6-f4e168da2e23 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.584243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-0775a807-75ab-4917-a4d2-90969cf72fff req-10146c28-0a74-4712-97d6-f4e168da2e23 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.595420 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-0775a807-75ab-4917-a4d2-90969cf72fff req-10146c28-0a74-4712-97d6-f4e168da2e23 service nova] Creating event network-vif-plugged:43f446cc-b2f0-4389-ba66-647b952de4e8 for instance 51b11b52-344f-40fa-9223-bde705aedfc9 on hv-cinder-84984 Jul 18 14:24:09.600567 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-0775a807-75ab-4917-a4d2-90969cf72fff req-10146c28-0a74-4712-97d6-f4e168da2e23 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 Jul 18 14:24:09.601325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 557/1087] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:09.988062 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:09.988673 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:09.995179 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.995626 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.996418 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.996849 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.011271 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:10.128063 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.136581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.138220 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.139381 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-9b11b9b6-ac2c-4bdf-85b5-a95e886245a2 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.155249 Jul 18 14:24:10.139935 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 531/1088] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:09 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:11.158508 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:11.159192 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:11.165328 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.165767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.166603 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.167031 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.301798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.310202 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.311691 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.312872 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3184c7a1-8720-4150-9ef9-e9268aea3f03 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1729 microversion: 2.20 time: 0.159094 Jul 18 14:24:11.313433 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 558/1089] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:11 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:12.330535 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:12.331155 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:12.337949 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:12.338397 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:12.339194 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:12.339631 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:12.466364 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:12.474300 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:12.475795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:12.476977 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-632f0ae6-8256-4d9f-811b-356d5498ab63 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1716 microversion: 2.20 time: 0.150333 Jul 18 14:24:12.477536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 532/1090] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:12 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:07.813721 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f039e12d-e719-4e93-bc3d-2b02bb24d57a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:07.814645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f039e12d-e719-4e93-bc3d-2b02bb24d57a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:07.817546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=25 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:07.818209 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=24 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:07.824544 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f039e12d-e719-4e93-bc3d-2b02bb24d57a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:07.825077 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f039e12d-e719-4e93-bc3d-2b02bb24d57a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:07.825858 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f039e12d-e719-4e93-bc3d-2b02bb24d57a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:07.826288 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f039e12d-e719-4e93-bc3d-2b02bb24d57a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:07.855257 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f039e12d-e719-4e93-bc3d-2b02bb24d57a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045432 Jul 18 14:25:07.855799 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 559/1091] 10.222.0.94 () {60 vars in 1342 bytes} [Mon Jul 18 14:25:07 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:07.912704 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:07.913199 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:07.915374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=25 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:07.916048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=9 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:07.921816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:07.922261 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:07.923021 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:07.923481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:07.949715 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:25:08.023625 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-96bb36d0-1d15-4b27-8c47-86b5b47368fc tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 204 len: 0 microversion: 2.20 time: 0.114395 Jul 18 14:25:08.024146 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 533/1092] 10.222.0.94 () {60 vars in 1279 bytes} [Mon Jul 18 14:25:07 2022] DELETE /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:25:08.032657 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:08.033285 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:08.039185 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:08.039626 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:08.040405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:08.040833 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:08.421008 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:08.429331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:08.430808 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:08.431934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-c4d0771d-fa33-4934-a22b-e3556785ac74 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.403270 Jul 18 14:25:08.432506 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 560/1093] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:08 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:09.452407 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:09.453115 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:09.460677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:09.461199 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:09.461965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:09.462394 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:09.589470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:09.597898 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:09.599391 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:09.600560 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-898ad385-f921-4b4f-94cf-4b714ce47d96 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1722 microversion: 2.20 time: 0.152582 Jul 18 14:25:09.601117 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 534/1094] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:09 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:25:10.476970 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-344c0ac0-92a0-48dd-a120-a3a4ba3a89c3 req-8a6764f1-4882-412f-9f20-893f6790d008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b11b52-344f-40fa-9223-bde705aedfc9", "name": "network-vif-deleted", "tag": "43f446cc-b2f0-4389-ba66-647b952de4e8"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:10.501663 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-344c0ac0-92a0-48dd-a120-a3a4ba3a89c3 req-8a6764f1-4882-412f-9f20-893f6790d008 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.502232 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-344c0ac0-92a0-48dd-a120-a3a4ba3a89c3 req-8a6764f1-4882-412f-9f20-893f6790d008 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.535822 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-344c0ac0-92a0-48dd-a120-a3a4ba3a89c3 req-8a6764f1-4882-412f-9f20-893f6790d008 service nova] Creating event network-vif-deleted:43f446cc-b2f0-4389-ba66-647b952de4e8 for instance 51b11b52-344f-40fa-9223-bde705aedfc9 on hv-cinder-84984 Jul 18 14:25:10.543489 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-344c0ac0-92a0-48dd-a120-a3a4ba3a89c3 req-8a6764f1-4882-412f-9f20-893f6790d008 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071037 Jul 18 14:25:10.544650 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 561/1095] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:10.618794 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:10.620127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:10.627749 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.629059 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.629899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.630393 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.663733 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.664201 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.664648 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lazy-loading 'fault' on Instance uuid 51b11b52-344f-40fa-9223-bde705aedfc9 {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:10.708427 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:10.716279 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:10.717754 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8561df96cd7c47c89d283e36fc637bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e0348cc781c4af3bfc3302499b19c74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:10.718879 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7e25ae17-914d-4cdf-ad99-7aa4b6d17d76 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 200 len: 1370 microversion: 2.20 time: 0.104006 Jul 18 14:25:10.719433 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 535/1096] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:10 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:11.739108 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:11.739800 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:11.745938 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:11.746381 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:11.747143 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:11.747577 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:11.761180 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] HTTP exception thrown: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Request method failure captured: Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 HTTP/1.1 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WtQ2RBeif8Sx9S2FnAHWHvPs86URT48ClicheKfWgH80B8SwrGCG2sqCZkiDvVhkRFqhrVAPwkb0COC1eJXDH0UD3jchjM38ValWChmcomnh5oFZ4DY7syjcvUwfErLLVgORHEk8a7Ki12pDszpztktOkccQ588jqWl7mdg84JAvt0 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:25:11.762767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3e0348cc781c4af3bfc3302499b19c74"}]}] Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 8561df96cd7c47c89d283e36fc637bb0 Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:11.764641 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '51b11b52-344f-40fa-9223-bde705aedfc9'} Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:11.765616 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:11.767277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:11.768813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Returning 404 to user: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:11.768813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-408c39d6-2929-4753-9bae-1da5ec3f499c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 404 len: 111 microversion: 2.20 time: 0.030346 Jul 18 14:25:11.768813 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 562/1097] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:11 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:25:11.773062 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-dd240467-b6e2-4afa-8942-e5c88517320e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '.version_select at 0x7f7b3b40c790>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:11.798044 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-dd240467-b6e2-4afa-8942-e5c88517320e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095628274" status: 204 len: 0 microversion: 2.20 time: 0.028826 Jul 18 14:25:11.798606 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 536/1098] 10.222.0.94 () {60 vars in 1261 bytes} [Mon Jul 18 14:25:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095628274 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:25:13.555914 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:13.556425 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:13.562830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.563273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:13.564060 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.564494 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:13.578602 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] HTTP exception thrown: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Request method failure captured: Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: DELETE /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 HTTP/1.1 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WtQ2RBeif8Sx9S2FnAHWHvPs86URT48ClicheKfWgH80B8SwrGCG2sqCZkiDvVhkRFqhrVAPwkb0COC1eJXDH0UD3jchjM38ValWChmcomnh5oFZ4DY7syjcvUwfErLLVgORHEk8a7Ki12pDszpztktOkccQ588jqWl7mdg84JAvt0 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:25:13.580182 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3e0348cc781c4af3bfc3302499b19c74"}]}] Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 8561df96cd7c47c89d283e36fc637bb0 Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.581893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '51b11b52-344f-40fa-9223-bde705aedfc9'} Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:13.582837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.584373 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.585904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Returning 404 to user: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:13.585904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ec47722e-2a0d-4b91-b0f4-ed9ec582890a tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 404 len: 111 microversion: 2.20 time: 0.029469 Jul 18 14:25:13.585904 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 563/1099] 10.222.0.94 () {60 vars in 1279 bytes} [Mon Jul 18 14:25:13 2022] DELETE /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:25:13.590071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:13.590680 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: 51b11b52-344f-40fa-9223-bde705aedfc9] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:13.598164 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.598604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:13.599386 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.599816 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:13.616398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] HTTP exception thrown: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Request method failure captured: Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 HTTP/1.1 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WtQ2RBeif8Sx9S2FnAHWHvPs86URT48ClicheKfWgH80B8SwrGCG2sqCZkiDvVhkRFqhrVAPwkb0COC1eJXDH0UD3jchjM38ValWChmcomnh5oFZ4DY7syjcvUwfErLLVgORHEk8a7Ki12pDszpztktOkccQ588jqWl7mdg84JAvt0 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:25:13.618281 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3e0348cc781c4af3bfc3302499b19c74"}]}] Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 8561df96cd7c47c89d283e36fc637bb0 Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.620097 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '51b11b52-344f-40fa-9223-bde705aedfc9'} Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:13.620985 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. Jul 18 14:25:13.622420 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:13.623923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Returning 404 to user: Instance 51b11b52-344f-40fa-9223-bde705aedfc9 could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:13.623923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-af0afa09-d627-4bcc-bf61-23365d8bfa57 tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9" status: 404 len: 111 microversion: 2.20 time: 0.033575 Jul 18 14:25:13.623923 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 537/1100] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:13 2022] GET /compute/v2.1/servers/51b11b52-344f-40fa-9223-bde705aedfc9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:25:14.751539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:14.752054 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:14.758495 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:14.758932 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:14.759678 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:14.760136 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:14.773632 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] HTTP exception thrown: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Request method failure captured: Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: DELETE /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a HTTP/1.1 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1WtQ2RBeif8Sx9S2FnAHWHvPs86URT48ClicheKfWgH80B8SwrGCG2sqCZkiDvVhkRFqhrVAPwkb0COC1eJXDH0UD3jchjM38ValWChmcomnh5oFZ4DY7syjcvUwfErLLVgORHEk8a7Ki12pDszpztktOkccQ588jqWl7mdg84JAvt0 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:25:14.775137 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3e0348cc781c4af3bfc3302499b19c74"}]}] Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: 8561df96cd7c47c89d283e36fc637bb0 Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.776886 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': 'c4858912-7c34-49ae-ad4b-ed96c3ca704a'} Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:14.777867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.779438 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.781412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Returning 404 to user: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:14.781412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-2f4a327b-c2dc-4c66-90af-1b41b467ca5c tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "DELETE /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 404 len: 111 microversion: 2.20 time: 0.028825 Jul 18 14:25:14.781412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 564/1101] 10.222.0.94 () {60 vars in 1279 bytes} [Mon Jul 18 14:25:14 2022] DELETE /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:25:14.785333 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:14.785963 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] [instance: c4858912-7c34-49ae-ad4b-ed96c3ca704a] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:14.792547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:14.793006 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:14.794047 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:14.794508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:14.808177 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] HTTP exception thrown: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Request method failure captured: Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a HTTP/1.1 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1WtQ2RBeif8Sx9S2FnAHWHvPs86URT48ClicheKfWgH80B8SwrGCG2sqCZkiDvVhkRFqhrVAPwkb0COC1eJXDH0UD3jchjM38ValWChmcomnh5oFZ4DY7syjcvUwfErLLVgORHEk8a7Ki12pDszpztktOkccQ588jqWl7mdg84JAvt0 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:25:14.809718 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3e0348cc781c4af3bfc3302499b19c74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3e0348cc781c4af3bfc3302499b19c74"}]}] Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 3e0348cc781c4af3bfc3302499b19c74 Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1692837702 Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: 8561df96cd7c47c89d283e36fc637bb0 Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1692837702-project Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.811453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': 'c4858912-7c34-49ae-ad4b-ed96c3ca704a'} Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:14.812425 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. Jul 18 14:25:14.813997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:25:14.815439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] Returning 404 to user: Instance c4858912-7c34-49ae-ad4b-ed96c3ca704a could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:14.815439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-49e0cc8e-32d7-4567-b9d8-1eb477027e2e tempest-AttachVolumeShelveTestJSON-1692837702 tempest-AttachVolumeShelveTestJSON-1692837702-project] 10.222.0.94 "GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a" status: 404 len: 111 microversion: 2.20 time: 0.030236 Jul 18 14:25:14.815439 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 538/1102] 10.222.0.94 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:14 2022] GET /compute/v2.1/servers/c4858912-7c34-49ae-ad4b-ed96c3ca704a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:26:38.380107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=12 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:38.380841 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=20 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:38.385292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1825269871", "imageRef": "435a1580-e56e-447b-9b57-7fef818c5956", "flavorRef": "452"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:38.438041 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] validate_networks() for None {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:26:38.707748 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:26:38.708199 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:26:38.708709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:26:38.709100 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:26:38.709504 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:26:38.719060 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:38.719502 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:38.720330 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:38.720762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:38.737484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Getting quotas for project 42094d28a16d4cae87e4488bf3794d72. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:26:38.741325 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Getting quotas for user a32edeb93d1343fa80f3756589c7e851 and project 42094d28a16d4cae87e4488bf3794d72. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:26:38.752145 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:26:38.754365 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='435a1580-e56e-447b-9b57-7fef818c5956',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:26:38.797923 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-60a00a27-3675-4f6c-bf3a-b25390dbe271 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.419550 Jul 18 14:26:38.798665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 565/1103] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:26:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:26:38.807964 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:38.808834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:38.813264 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-381dbfb8-008b-40e6-98e5-7cfeb65575d8 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:38.813874 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-381dbfb8-008b-40e6-98e5-7cfeb65575d8 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:38.872848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-381dbfb8-008b-40e6-98e5-7cfeb65575d8 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:38.879301 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-381dbfb8-008b-40e6-98e5-7cfeb65575d8 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1215 microversion: 2.1 time: 0.073464 Jul 18 14:26:38.879843 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 539/1104] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:38 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:39.896064 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-072b8a02-b9a0-4c29-b47c-f713936e4c50 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:39.896903 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-072b8a02-b9a0-4c29-b47c-f713936e4c50 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:39.950869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-072b8a02-b9a0-4c29-b47c-f713936e4c50 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:39.957481 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-072b8a02-b9a0-4c29-b47c-f713936e4c50 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1215 microversion: 2.1 time: 0.065286 Jul 18 14:26:39.958273 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 566/1105] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:39 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:40.974547 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7b87b5a8-0093-4c59-bf1c-136dcd596540 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:40.975154 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7b87b5a8-0093-4c59-bf1c-136dcd596540 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:41.027157 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7b87b5a8-0093-4c59-bf1c-136dcd596540 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:41.033876 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7b87b5a8-0093-4c59-bf1c-136dcd596540 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1215 microversion: 2.1 time: 0.063214 Jul 18 14:26:41.034435 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 540/1106] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:40 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:42.050613 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-0f6c24c6-f1d3-43b5-850f-bf2f30aee12d tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:42.051224 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-0f6c24c6-f1d3-43b5-850f-bf2f30aee12d tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:42.103224 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-0f6c24c6-f1d3-43b5-850f-bf2f30aee12d tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:42.109884 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-0f6c24c6-f1d3-43b5-850f-bf2f30aee12d tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1215 microversion: 2.1 time: 0.063166 Jul 18 14:26:42.110440 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 567/1107] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:42 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:43.127150 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:43.127754 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:43.134804 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:43.135247 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:43.136028 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:43.136470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:43.198665 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:43.206093 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f8843aff-7d19-4bdc-8c41-147d37e6c938 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1219 microversion: 2.1 time: 0.082774 Jul 18 14:26:43.206587 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 541/1108] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:43 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:44.223045 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:44.224322 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:44.231361 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:44.231801 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:44.232893 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:44.233331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:44.585662 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:44.593911 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9cc71e35-93c0-43de-94a9-0f8582385ef0 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1273 microversion: 2.1 time: 0.375131 Jul 18 14:26:44.603343 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 568/1109] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:44 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1273 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:45.611679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:45.613212 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:45.623305 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:45.632496 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:45.633542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:45.634081 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:45.814945 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-a58b60a6-4c6f-4e00-bab7-df47c89c4dfe req-ef3fd540-dc67-428b-b579-be2aab35318c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d", "tag": "4ba87573-db3a-4877-9bd3-5f571a7d11f1"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:45.823934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-a58b60a6-4c6f-4e00-bab7-df47c89c4dfe req-ef3fd540-dc67-428b-b579-be2aab35318c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:45.824401 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-a58b60a6-4c6f-4e00-bab7-df47c89c4dfe req-ef3fd540-dc67-428b-b579-be2aab35318c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:45.835321 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-a58b60a6-4c6f-4e00-bab7-df47c89c4dfe req-ef3fd540-dc67-428b-b579-be2aab35318c service nova] Creating event network-changed:4ba87573-db3a-4877-9bd3-5f571a7d11f1 for instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d on hv-cinder-84984 Jul 18 14:26:45.840948 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-a58b60a6-4c6f-4e00-bab7-df47c89c4dfe req-ef3fd540-dc67-428b-b579-be2aab35318c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228756 Jul 18 14:26:45.841540 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 569/1110] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:45.898297 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:45.907005 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-5f7a5be6-c63d-4fdd-87c1-5de817a0fc1e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1315 microversion: 2.1 time: 0.299746 Jul 18 14:26:45.907617 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 542/1111] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:45 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:46.924511 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:46.925209 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:46.931424 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.931869 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.932810 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.933271 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:47.073819 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:47.081249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a717abb1-f817-4546-9adc-865f8c58b2db tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1315 microversion: 2.1 time: 0.161477 Jul 18 14:26:47.081814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 570/1112] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:46 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:48.097539 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:48.098153 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:48.104838 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:48.105286 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:48.106048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:48.106486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:48.237027 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:48.244927 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-40a4a685-276f-44b9-912a-7a7387349e5e tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1315 microversion: 2.1 time: 0.151240 Jul 18 14:26:48.245481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 543/1113] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:48 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:26:49.261372 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:49.261984 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:49.264392 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:49.269854 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:49.270305 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:49.271074 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:49.271509 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:49.397811 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:49.405669 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-bd1285ee-8820-4b8c-a2c5-7ad9369bdc5a tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1315 microversion: 2.1 time: 0.148187 Jul 18 14:26:49.406234 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 571/1114] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:49 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:50.422581 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:50.423188 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:50.429611 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:50.430057 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:50.430822 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:50.431258 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:50.567466 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-d56beb26-b087-471b-b79d-5ba6d52f45e5 req-58ae048b-6333-42d1-9b55-13238490532c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d", "name": "network-vif-plugged", "status": "completed", "tag": "4ba87573-db3a-4877-9bd3-5f571a7d11f1"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:50.575916 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-d56beb26-b087-471b-b79d-5ba6d52f45e5 req-58ae048b-6333-42d1-9b55-13238490532c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:50.576385 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-d56beb26-b087-471b-b79d-5ba6d52f45e5 req-58ae048b-6333-42d1-9b55-13238490532c service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:50.579660 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:50.587693 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b323831e-c7fa-4b84-be7a-4c47e718e93f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1315 microversion: 2.1 time: 0.168942 Jul 18 14:26:50.588002 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-d56beb26-b087-471b-b79d-5ba6d52f45e5 req-58ae048b-6333-42d1-9b55-13238490532c service nova] Creating event network-vif-plugged:4ba87573-db3a-4877-9bd3-5f571a7d11f1 for instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d on hv-cinder-84984 Jul 18 14:26:50.588282 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 544/1115] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:50 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:50.593110 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-d56beb26-b087-471b-b79d-5ba6d52f45e5 req-58ae048b-6333-42d1-9b55-13238490532c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157936 Jul 18 14:26:50.593697 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 572/1116] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:26:51.604524 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:51.605125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:51.606953 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=4 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:51.613498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:51.613937 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:51.614699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:51.615123 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:51.742164 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:51.750127 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-8092cc04-e098-4d3b-aba9-1468a0c6d780 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1315 microversion: 2.1 time: 0.149450 Jul 18 14:26:51.750689 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 545/1117] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:51 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:52.764516 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=10 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:52.768589 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:52.769275 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:52.775690 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.776158 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.776907 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.777335 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.907355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:52.914777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6be30f66-06ee-4625-bb8d-a9dbc115735f tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1464 microversion: 2.1 time: 0.151705 Jul 18 14:26:52.915920 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 573/1118] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:52 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:52.954252 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:52.954758 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:52.961148 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.961591 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.962858 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.963283 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.988994 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:26:53.060766 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-48b5adc9-fb35-4003-a477-b5f61e9dd2cf tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "DELETE /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 204 len: 0 microversion: 2.1 time: 0.109919 Jul 18 14:26:53.061267 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 546/1119] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:26:52 2022] DELETE /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:26:53.070873 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:53.071654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:53.077681 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:53.078120 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:53.078871 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:53.079292 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:53.207743 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:53.215812 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-9dfef5a7-7796-432b-8126-f1f159941415 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1470 microversion: 2.1 time: 0.149135 Jul 18 14:26:53.216861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 574/1120] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:53 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:54.234166 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:54.234779 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:54.241277 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.241723 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.242482 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.242914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.373756 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:54.381275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-91eaa405-9bc3-478d-9be0-fd6a954747a3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1470 microversion: 2.1 time: 0.151397 Jul 18 14:26:54.381840 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 547/1121] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:54 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:55.133169 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-bc711125-a3b0-4ea0-b620-03b6b2ad0f2c req-057ace93-847b-455d-9d68-86e482e156a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d", "name": "network-vif-deleted", "tag": "4ba87573-db3a-4877-9bd3-5f571a7d11f1"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:55.150229 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-bc711125-a3b0-4ea0-b620-03b6b2ad0f2c req-057ace93-847b-455d-9d68-86e482e156a0 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.150731 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-bc711125-a3b0-4ea0-b620-03b6b2ad0f2c req-057ace93-847b-455d-9d68-86e482e156a0 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.163661 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-bc711125-a3b0-4ea0-b620-03b6b2ad0f2c req-057ace93-847b-455d-9d68-86e482e156a0 service nova] Creating event network-vif-deleted:4ba87573-db3a-4877-9bd3-5f571a7d11f1 for instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d on hv-cinder-84984 Jul 18 14:26:55.168654 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-bc711125-a3b0-4ea0-b620-03b6b2ad0f2c req-057ace93-847b-455d-9d68-86e482e156a0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Jul 18 14:26:55.169251 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 575/1122] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:55.398288 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:55.398899 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:55.405892 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.406343 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.407108 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.407543 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.437448 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.437890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.438334 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.objects.instance [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lazy-loading 'fault' on Instance uuid 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d {{(pid=117846) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:26:55.478820 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32edeb93d1343fa80f3756589c7e851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42094d28a16d4cae87e4488bf3794d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:55.486151 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-324efbe0-a074-4faa-bf71-10c1b41441de tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 200 len: 1305 microversion: 2.1 time: 0.091699 Jul 18 14:26:55.486705 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 548/1123] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:55 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:56.503547 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:56.504286 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] [instance: 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:56.510449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:56.510892 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:56.511645 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:56.512114 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:56.524967 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] HTTP exception thrown: Instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d could not be found. Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Request method failure captured: Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d HTTP/1.1 Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1W2cZqsU3cbn4AqrVosYjxBQCsLvjlyplWSsZMP3EYD3LTt5nQ7poEPzQuyjeN72O3xj_QMwkKmaN0AHcddAigcaepsCTDnsuTCd4wqZ5BNT6oZVptYkAgSU9HMYBhc3s5uoO__jH0wiXL_p8StoK_yrbDZVCyjIq4NUHXHqP5gLxE0 Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 42094d28a16d4cae87e4488bf3794d72 Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-VolumesNegativeTest-799817809 Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:26:56.526488 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/42094d28a16d4cae87e4488bf3794d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/42094d28a16d4cae87e4488bf3794d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/42094d28a16d4cae87e4488bf3794d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_42094d28a16d4cae87e4488bf3794d72"}]}] Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-VolumesNegativeTest-799817809 Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 42094d28a16d4cae87e4488bf3794d72 Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-VolumesNegativeTest-799817809 Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-VolumesNegativeTest-799817809-project Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: a32edeb93d1343fa80f3756589c7e851 Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-VolumesNegativeTest-799817809-project Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d could not be found. Jul 18 14:26:56.528309 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'id': '44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d'} Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d could not be found. Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:26:56.529493 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d could not be found. Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d could not be found. Jul 18 14:26:56.531164 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:26:56.532703 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] Returning 404 to user: Instance 44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d could not be found. {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:26:56.532703 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-49001063-e652-46e0-b46c-0ca62bb51fe3 tempest-VolumesNegativeTest-799817809 tempest-VolumesNegativeTest-799817809-project] 10.222.0.94 "GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d" status: 404 len: 111 microversion: 2.1 time: 0.029009 Jul 18 14:26:56.532703 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 576/1124] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:56 2022] GET /compute/v2.1/servers/44ac2f6d-0f49-43fd-ad0b-8411ccd24c5d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:03.191847 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:27:03.192453 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:27:03.842224 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:27:03.842687 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Mon Jul 18 14:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:27:19.253806 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-06d2422d-40b1-4a81-9047-4908149bd425 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Action: 'create', calling method: .version_select at 0x7f7b3b30c670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1468173844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHjQDJfnJAp1D/9Irlid+miqNo7IkgzLRPnlUwCtr2MeuOHMn5RZMQQO3Fp57dpJN24xAzSPBUSQi4hu36EqPAZ7EK65q5qkjGVFYvL6n/XreEe6g9jloDvQSmEmXrJPw=="}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:19.258481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:19.259134 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:19.274561 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-06d2422d-40b1-4a81-9047-4908149bd425 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Getting quotas for project 0c3ec8c8d2f84ab1a84a1f64fd8a66c7. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:27:19.278358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.quota [None req-06d2422d-40b1-4a81-9047-4908149bd425 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Getting quotas for user caa872b8a1184533b7b57f0426d2e34c and project 0c3ec8c8d2f84ab1a84a1f64fd8a66c7. Resources: {'key_pairs'} {{(pid=117846) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:27:19.299819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-06d2422d-40b1-4a81-9047-4908149bd425 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.050015 Jul 18 14:27:19.300423 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 549/1125] 10.222.0.94 () {60 vars in 1158 bytes} [Mon Jul 18 14:27:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:19.348245 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-226283157", "imageRef": "0dd872fe-d212-43ee-89f9-ef14258c260b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1468173844", "networks": [{"uuid": "de0f7f4d-0248-4952-aa6a-3352dc26a0bf"}]}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:19.356112 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:19.356782 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=40 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:19.401668 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.network.neutron [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] validate_networks() for [('de0f7f4d-0248-4952-aa6a-3352dc26a0bf', None, None, None, None, None)] {{(pid=117845) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:27:19.851549 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Flavor limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:27:19.852052 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Image limits 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:27:19.852520 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Flavor pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:27:19.852920 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Image pref 0:0:0 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:27:19.853319 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.virt.hardware [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117845) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:27:19.862824 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:19.863269 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:19.864110 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:19.864539 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:19.881153 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Getting quotas for project 0c3ec8c8d2f84ab1a84a1f64fd8a66c7. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:27:19.885541 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.quota [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Getting quotas for user caa872b8a1184533b7b57f0426d2e34c and project 0c3ec8c8d2f84ab1a84a1f64fd8a66c7. Resources: {'ram', 'cores', 'instances'} {{(pid=117845) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:27:19.896419 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Going to run 1 instances... {{(pid=117845) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:27:19.898653 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0dd872fe-d212-43ee-89f9-ef14258c260b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117845) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:27:19.943568 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-1cbe6afb-8f23-4c45-8a57-0994ffa3d7c1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599269 Jul 18 14:27:19.944405 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 577/1126] 10.222.0.94 () {60 vars in 1146 bytes} [Mon Jul 18 14:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:27:19.954867 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-54d534a8-aa93-4d4e-a229-a3135ca2b6f4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:19.955720 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-54d534a8-aa93-4d4e-a229-a3135ca2b6f4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:20.009121 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-54d534a8-aa93-4d4e-a229-a3135ca2b6f4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:20.015827 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-54d534a8-aa93-4d4e-a229-a3135ca2b6f4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1258 microversion: 2.1 time: 0.064774 Jul 18 14:27:20.016638 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 550/1127] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:19 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:21.033732 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:21.034647 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:21.042647 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:21.043104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:21.044570 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:21.045534 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:21.148712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:21.156120 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-eb71c112-d010-4a91-8ec2-10be3e1e5b5f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1316 microversion: 2.1 time: 0.126900 Jul 18 14:27:21.156919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 578/1128] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:21 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1316 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:22.173760 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:22.174369 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:22.181720 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:22.182178 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:22.182955 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:22.183391 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:22.316615 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:22.324615 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-f9b6b597-1b8a-49d0-bcff-72793f88e15a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.154646 Jul 18 14:27:22.325271 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 551/1129] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:22 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:23.343091 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:23.343640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:23.350407 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:23.350857 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:23.352188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:23.352825 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:23.490924 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:23.499552 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-4816227d-0a9d-4c43-a8e1-f205bd4d653e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.161795 Jul 18 14:27:23.500160 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 579/1130] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:23 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:24.516231 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:24.516848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:24.523621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:24.524356 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:24.525331 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:24.525956 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:24.660240 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:24.667818 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-7005ced0-6ad4-4d53-abf0-4893b2a6b878 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.155445 Jul 18 14:27:24.668411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 552/1131] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:24 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:25.685665 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:25.686271 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:25.692745 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:25.693185 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:25.693946 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:25.694370 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:25.833418 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:25.841975 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f85c1db0-3a17-4ab9-b056-dc20dc4d9ab3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.160492 Jul 18 14:27:25.842555 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 580/1132] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:25 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:26.858726 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:26.859305 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:26.865809 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:26.866260 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:26.867035 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:26.867980 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:27.013604 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:27.021182 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-278c3b74-caf4-467a-9e75-d27898d9a459 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.166354 Jul 18 14:27:27.025447 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 553/1133] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:26 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:28.037934 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:28.038528 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:28.045277 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:28.045717 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:28.046485 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:28.046919 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:28.182240 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:28.189925 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-a8b57e11-45d8-426c-b6cd-23250a76bdeb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.155769 Jul 18 14:27:28.190712 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 581/1134] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:28 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:29.206914 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:29.207498 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:29.213963 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:29.214411 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:29.215169 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:29.221946 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:29.344974 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:29.352253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-e7deb53c-294a-4f68-a5b8-a5771d69de07 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.149211 Jul 18 14:27:29.352810 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 554/1135] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:29 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:30.369514 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:30.370124 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:30.372462 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:30.373235 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=6 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:30.379352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:30.379794 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:30.380587 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:30.381019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:30.509313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:30.517595 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-cc953bf0-e415-48af-a996-f87d725d5781 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.152478 Jul 18 14:27:30.518155 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 582/1136] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:30 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:27:31.534401 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:31.534955 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:31.536806 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell0:SELECT=6 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:31.543436 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:31.543890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:31.544679 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:31.545125 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:31.673542 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:31.680884 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-657dbd83-50bd-431f-a354-abd3ed8ad7f0 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.150430 Jul 18 14:27:31.682073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 555/1137] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:31 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:32.420740 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-c1f2e049-55cc-4f74-8666-80f9f5226868 req-f926e0df-62d2-47bb-8b14-62a9adc4dbae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf4fc5c-2305-44ba-9197-40dfbcd5d96b", "tag": "e7be45a5-e6d5-40ec-aec1-5e1463f9272c"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:32.430767 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-c1f2e049-55cc-4f74-8666-80f9f5226868 req-f926e0df-62d2-47bb-8b14-62a9adc4dbae service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:32.431458 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-c1f2e049-55cc-4f74-8666-80f9f5226868 req-f926e0df-62d2-47bb-8b14-62a9adc4dbae service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:32.443412 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-c1f2e049-55cc-4f74-8666-80f9f5226868 req-f926e0df-62d2-47bb-8b14-62a9adc4dbae service nova] Creating event network-changed:e7be45a5-e6d5-40ec-aec1-5e1463f9272c for instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b on hv-cinder-84984 Jul 18 14:27:32.450798 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-c1f2e049-55cc-4f74-8666-80f9f5226868 req-f926e0df-62d2-47bb-8b14-62a9adc4dbae service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033514 Jul 18 14:27:32.451814 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 583/1138] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:32.697771 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:32.698510 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:32.704952 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:32.705401 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:32.706167 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:32.706597 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:32.872833 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:32.880162 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1bd755ee-f21d-4273-ad21-2d04d69213d8 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.186506 Jul 18 14:27:32.880727 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 556/1139] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:32 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:33.898698 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:33.899394 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:33.906222 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:33.906670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:33.907433 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:33.907867 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:34.043226 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:34.051331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-6f46ddd5-997e-4cb4-a058-7f527a4d8e03 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.157363 Jul 18 14:27:34.051905 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 584/1140] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:33 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:35.068742 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:35.069287 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:35.076003 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:35.076454 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:35.077245 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:35.077681 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:35.205561 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:35.212855 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-91860909-77d2-450e-99f6-7e8cee1eb63e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.148038 Jul 18 14:27:35.213424 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 557/1141] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:35 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:36.229887 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:36.230447 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:36.237162 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:36.237583 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:36.238355 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:36.238790 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:36.364073 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:36.371837 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-8922598c-b2cf-4d7b-a3bb-2be46fbbc710 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.145960 Jul 18 14:27:36.372417 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 585/1142] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:36 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:37.389029 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:37.389638 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:37.396141 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:37.396586 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:37.397343 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:37.397774 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:37.534008 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:37.541253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1310d12e-6394-455e-b0a9-9515783f39d7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.156705 Jul 18 14:27:37.541804 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 558/1143] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:37 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:38.558981 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:38.559768 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:38.566207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:38.566656 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:38.567428 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:38.567861 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:38.591673 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-61c0df25-e98e-430c-9cf4-a7d903b558fc req-d5a7ae0b-b355-46f3-ba27-a1c589b301bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf4fc5c-2305-44ba-9197-40dfbcd5d96b", "name": "network-vif-plugged", "status": "completed", "tag": "e7be45a5-e6d5-40ec-aec1-5e1463f9272c"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:38.603213 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-61c0df25-e98e-430c-9cf4-a7d903b558fc req-d5a7ae0b-b355-46f3-ba27-a1c589b301bc service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:38.603741 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-61c0df25-e98e-430c-9cf4-a7d903b558fc req-d5a7ae0b-b355-46f3-ba27-a1c589b301bc service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:38.616240 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-61c0df25-e98e-430c-9cf4-a7d903b558fc req-d5a7ae0b-b355-46f3-ba27-a1c589b301bc service nova] Creating event network-vif-plugged:e7be45a5-e6d5-40ec-aec1-5e1463f9272c for instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b on hv-cinder-84984 Jul 18 14:27:38.622216 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-61c0df25-e98e-430c-9cf4-a7d903b558fc req-d5a7ae0b-b355-46f3-ba27-a1c589b301bc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034809 Jul 18 14:27:38.623055 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 559/1144] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:27:38.707855 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:38.715437 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b235a265-c448-46cb-9ee9-b360ecb4494f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.160834 Jul 18 14:27:38.716020 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 586/1145] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:38 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:39.733203 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:39.733887 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:39.740232 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:39.740682 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:39.741450 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:39.741884 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:40.130119 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:40.137442 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-65bcbd9a-3fe5-46fa-a476-9ddc04285899 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1358 microversion: 2.1 time: 0.409587 Jul 18 14:27:40.137993 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 560/1146] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:39 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1358 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:41.153778 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:41.154418 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:41.161005 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.161449 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.162207 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.162638 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.289776 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:41.297333 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f0ee0ed2-9eac-4506-b81b-907a2c455f1f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1549 microversion: 2.1 time: 0.147964 Jul 18 14:27:41.297891 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 587/1147] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:41 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:41.313295 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:41.313911 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:41.320978 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.321501 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.322371 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.322809 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.451859 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:41.459284 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-89220c9e-5d09-47f8-836b-be32b5aacafa tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1549 microversion: 2.1 time: 0.149772 Jul 18 14:27:41.459845 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 561/1148] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:41 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:41.475213 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:41.478558 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:41.479324 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Searching by: {'deleted': False, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7'} {{(pid=117845) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 14:27:41.485980 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.486352 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.487147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.487581 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.575030 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.multi_cell_list [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117845) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 14:27:41.669483 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-45dbd360-7f2c-4d1e-bb1a-ce1af2828b77 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.197917 Jul 18 14:27:41.670069 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 588/1149] 10.222.0.94 () {58 vars in 1124 bytes} [Mon Jul 18 14:27:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:41.680143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:41.680819 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:41.687370 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.687805 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.688587 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.689016 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.816456 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:41.824856 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-2b78cc92-449a-455b-9c0b-a7de388a6289 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1549 microversion: 2.1 time: 0.148521 Jul 18 14:27:41.825445 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 562/1150] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:41 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:43.336271 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-008d2605-ccf3-4eda-b96e-a8ea7f293f8b tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad158287-5fa8-434f-be6b-c7816ccbe44b"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:43.337331 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-008d2605-ccf3-4eda-b96e-a8ea7f293f8b tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:43.344357 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-008d2605-ccf3-4eda-b96e-a8ea7f293f8b tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:43.344804 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-008d2605-ccf3-4eda-b96e-a8ea7f293f8b tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:43.345569 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-008d2605-ccf3-4eda-b96e-a8ea7f293f8b tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:43.346031 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-008d2605-ccf3-4eda-b96e-a8ea7f293f8b tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:43.595636 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-008d2605-ccf3-4eda-b96e-a8ea7f293f8b tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263081 Jul 18 14:27:43.596284 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 589/1151] 10.222.0.94 () {60 vars in 1322 bytes} [Mon Jul 18 14:27:43 2022] POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:51.133896 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:51.134511 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:51.136616 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:51.142890 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:51.143338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:51.144136 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:51.144575 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:51.148954 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=69 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:51.275672 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:51.285536 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-70ade74d-1285-440f-8189-c6b43eb35eda tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1595 microversion: 2.1 time: 0.155530 Jul 18 14:27:51.286112 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 563/1152] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:51 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:52.890531 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-884b0f75-7aa6-45a8-bb84-d2037a498ae2 req-0ef9a5d8-fe95-4267-a727-efe8618dc326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf4fc5c-2305-44ba-9197-40dfbcd5d96b", "tag": "e7be45a5-e6d5-40ec-aec1-5e1463f9272c"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:52.896016 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell0:SELECT=2 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:52.897293 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:52.902693 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-884b0f75-7aa6-45a8-bb84-d2037a498ae2 req-0ef9a5d8-fe95-4267-a727-efe8618dc326 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:52.903393 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-884b0f75-7aa6-45a8-bb84-d2037a498ae2 req-0ef9a5d8-fe95-4267-a727-efe8618dc326 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:52.908080 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:52.919192 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-884b0f75-7aa6-45a8-bb84-d2037a498ae2 req-0ef9a5d8-fe95-4267-a727-efe8618dc326 service nova] Creating event network-changed:e7be45a5-e6d5-40ec-aec1-5e1463f9272c for instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b on hv-cinder-84984 Jul 18 14:27:52.925635 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-884b0f75-7aa6-45a8-bb84-d2037a498ae2 req-0ef9a5d8-fe95-4267-a727-efe8618dc326 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040170 Jul 18 14:27:52.926733 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 590/1153] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:53.925090 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-867161195"}} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:53.925640 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:53.932486 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:53.933475 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:53.934227 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:53.934655 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:54.083913 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.network.security_group_api [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Adding security group 4dfea752-e04e-4aa8-a8af-7507384873b3 to port e7be45a5-e6d5-40ec-aec1-5e1463f9272c Jul 18 14:27:54.455470 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-711cafb6-a68e-455e-9535-30769eb9babd tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/action" status: 202 len: 0 microversion: 2.1 time: 0.533851 Jul 18 14:27:54.468621 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 564/1154] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:27:53 2022] POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:27:54.470569 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:54.471918 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:54.479295 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:54.480448 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:54.481197 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:54.481933 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:54.646019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:54.655099 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b940c128-ad67-41ef-814f-6eb6a77c19d4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1759 microversion: 2.1 time: 0.191695 Jul 18 14:27:54.655674 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 591/1155] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:54 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:54.942211 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-3a7d357d-dc1a-4340-a757-939bfd0d095a req-8bc833f2-1b24-4936-8ccb-59c58c6fdea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf4fc5c-2305-44ba-9197-40dfbcd5d96b", "tag": "e7be45a5-e6d5-40ec-aec1-5e1463f9272c"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:54.952045 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-3a7d357d-dc1a-4340-a757-939bfd0d095a req-8bc833f2-1b24-4936-8ccb-59c58c6fdea5 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:54.952487 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-3a7d357d-dc1a-4340-a757-939bfd0d095a req-8bc833f2-1b24-4936-8ccb-59c58c6fdea5 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:54.973413 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-3a7d357d-dc1a-4340-a757-939bfd0d095a req-8bc833f2-1b24-4936-8ccb-59c58c6fdea5 service nova] Creating event network-changed:e7be45a5-e6d5-40ec-aec1-5e1463f9272c for instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b on hv-cinder-84984 Jul 18 14:27:54.978812 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-3a7d357d-dc1a-4340-a757-939bfd0d095a req-8bc833f2-1b24-4936-8ccb-59c58c6fdea5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040739 Jul 18 14:27:54.979930 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 565/1156] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:55.185777 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=3 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:55.186515 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=7 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:55.191105 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-864feaca-375a-4e06-87fa-16848a176fc1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:55.192670 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-864feaca-375a-4e06-87fa-16848a176fc1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:55.199644 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-864feaca-375a-4e06-87fa-16848a176fc1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.200119 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-864feaca-375a-4e06-87fa-16848a176fc1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.200881 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-864feaca-375a-4e06-87fa-16848a176fc1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.201313 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-864feaca-375a-4e06-87fa-16848a176fc1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.269408 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-864feaca-375a-4e06-87fa-16848a176fc1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/action" status: 202 len: 0 microversion: 2.1 time: 0.085085 Jul 18 14:28:55.270711 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 592/1157] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:28:55 2022] POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:28:55.276980 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=5 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:55.277781 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=11 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:55.282354 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:55.283048 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:55.290214 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.290651 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.291480 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.291834 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.642588 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:55.650513 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-1b3d2595-9f5b-4805-baff-edbdfb5cc0eb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1751 microversion: 2.1 time: 0.375556 Jul 18 14:28:55.651071 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 566/1158] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:55 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1751 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:56.669067 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:56.669764 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:56.675969 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:56.676437 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:56.677208 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:56.677640 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:56.869546 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:56.877445 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ddf2d648-6c3a-42bf-ac5a-99249618d54e tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.213219 Jul 18 14:28:56.878003 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 593/1159] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:56 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:57.895752 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:57.896374 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:57.902825 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:57.903274 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:57.904073 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:57.904508 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:58.047507 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:58.055848 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-32b33e38-1cd6-4439-999e-50b2f52a4f43 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.164471 Jul 18 14:28:58.056431 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 567/1160] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:57 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:59.073403 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:59.074015 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:59.080484 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:59.080931 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:59.081690 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:59.082707 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:59.221903 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:59.229874 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-450a40ab-b238-42ad-b3c5-0a7922c55481 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.160554 Jul 18 14:28:59.230432 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 594/1161] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:59 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:00.245965 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:00.246516 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:00.252967 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:00.253416 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:00.254173 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:00.254607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:00.398509 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:00.406677 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-cb0d1219-62f0-4cb7-ba21-26b13196cbb1 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.164567 Jul 18 14:29:00.407213 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 568/1162] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:00 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:01.423376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:01.423991 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:01.430601 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:01.431037 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:01.431792 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:01.432242 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:01.570389 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:01.578540 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-b07e6996-c0bf-4160-8a0a-a440b66b8350 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.158987 Jul 18 14:29:01.579107 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 595/1163] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:01 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:02.595964 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:02.596517 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:02.603489 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:02.603930 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:02.604713 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:02.605143 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:02.745144 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:02.753268 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-fa6a0216-288a-4b5d-8b72-501f4cdd56cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.161267 Jul 18 14:29:02.754335 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 569/1164] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:02 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:03.771188 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:03.771789 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:03.778184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:03.778619 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:03.779367 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:03.779791 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:03.921762 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:03.930157 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-37fb410e-c407-4d05-af30-5461c9a12895 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.163437 Jul 18 14:29:03.930727 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 596/1165] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:03 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:04.947426 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:04.948075 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:04.954481 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:04.954928 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:04.955693 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:04.956156 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:05.095870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:05.104301 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-121e23b7-7cf3-4b28-b331-ebe0b686bf87 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.160996 Jul 18 14:29:05.104861 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 570/1166] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:04 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:06.122009 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:06.122659 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:06.129939 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:06.130383 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:06.131150 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:06.131584 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:06.272808 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:06.280580 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-f165e6e9-eab1-4985-b9cf-879fd1aa24bf tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1756 microversion: 2.1 time: 0.162383 Jul 18 14:29:06.281139 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 597/1167] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:06 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:07.297583 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:07.298225 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:07.305358 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:07.305803 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:07.306572 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:07.306999 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:07.456943 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:07.465413 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-af1b42fa-6cd9-4461-bd83-c4e536f47002 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1759 microversion: 2.1 time: 0.171736 Jul 18 14:29:07.465971 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 571/1168] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:07 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:30:10.825345 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_api:SELECT=12 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:30:10.826542 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG dbcounter [-] [117845] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117845) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:30:10.830634 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-867161195"}} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:30:10.831147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:10.840181 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:10.840626 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:10.841397 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:10.841834 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:10.974746 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.network.security_group_api [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Removing security group 4dfea752-e04e-4aa8-a8af-7507384873b3 from port e7be45a5-e6d5-40ec-aec1-5e1463f9272c Jul 18 14:30:11.307219 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-13d1163f-c0e4-4f11-966a-8d501391478f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/action" status: 202 len: 0 microversion: 2.1 time: 0.483675 Jul 18 14:30:11.308258 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 598/1169] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Jul 18 14:30:10 2022] POST /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:30:11.318752 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-679b97a4-b025-4afb-bf67-c1c46131e4a7 req-0480ad95-24da-4fce-ba4c-07b9e3725dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf4fc5c-2305-44ba-9197-40dfbcd5d96b", "tag": "e7be45a5-e6d5-40ec-aec1-5e1463f9272c"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:30:11.328526 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_api:SELECT=12 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:30:11.329514 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG dbcounter [-] [117846] Writing DB stats nova_cell1:SELECT=36 {{(pid=117846) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:30:11.332697 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-679b97a4-b025-4afb-bf67-c1c46131e4a7 req-0480ad95-24da-4fce-ba4c-07b9e3725dcb service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:11.333382 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-679b97a4-b025-4afb-bf67-c1c46131e4a7 req-0480ad95-24da-4fce-ba4c-07b9e3725dcb service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:11.363109 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-679b97a4-b025-4afb-bf67-c1c46131e4a7 req-0480ad95-24da-4fce-ba4c-07b9e3725dcb service nova] Creating event network-changed:e7be45a5-e6d5-40ec-aec1-5e1463f9272c for instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b on hv-cinder-84984 Jul 18 14:30:11.368870 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-679b97a4-b025-4afb-bf67-c1c46131e4a7 req-0480ad95-24da-4fce-ba4c-07b9e3725dcb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055824 Jul 18 14:30:11.370124 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 572/1170] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:30:12.931163 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:12.931656 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:12.938099 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:12.938554 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:12.939332 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:12.939769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:13.021875 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.objects.instance [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lazy-loading 'services' on Instance uuid 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b {{(pid=117845) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:30:13.099384 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-ecf80fee-01b5-45d3-8a65-495a53eceba7 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments/ad158287-5fa8-434f-be6b-c7816ccbe44b" status: 202 len: 0 microversion: 2.1 time: 0.172575 Jul 18 14:30:13.100247 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 599/1171] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:30:12 2022] DELETE /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments/ad158287-5fa8-434f-be6b-c7816ccbe44b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:30:13.110996 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-703a9d42-1fa1-4cd1-b2fb-eb5fcd9d424c tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:13.113336 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-703a9d42-1fa1-4cd1-b2fb-eb5fcd9d424c tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:13.122193 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-703a9d42-1fa1-4cd1-b2fb-eb5fcd9d424c tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:13.122901 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-703a9d42-1fa1-4cd1-b2fb-eb5fcd9d424c tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:13.123671 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-703a9d42-1fa1-4cd1-b2fb-eb5fcd9d424c tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:13.124137 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-703a9d42-1fa1-4cd1-b2fb-eb5fcd9d424c tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:13.158699 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-703a9d42-1fa1-4cd1-b2fb-eb5fcd9d424c tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053136 Jul 18 14:30:13.159253 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 573/1172] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:30:13 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:30:13.384773 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [req-8ca18886-dc87-490a-8acd-0875d52c73e9 req-ac99c66d-5418-4d18-a010-8fb36cd6ecd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf4fc5c-2305-44ba-9197-40dfbcd5d96b", "tag": "e7be45a5-e6d5-40ec-aec1-5e1463f9272c"}]} {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:30:13.395341 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-8ca18886-dc87-490a-8acd-0875d52c73e9 req-ac99c66d-5418-4d18-a010-8fb36cd6ecd0 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:13.395812 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [req-8ca18886-dc87-490a-8acd-0875d52c73e9 req-ac99c66d-5418-4d18-a010-8fb36cd6ecd0 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:13.408243 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.compute.server_external_events [req-8ca18886-dc87-490a-8acd-0875d52c73e9 req-ac99c66d-5418-4d18-a010-8fb36cd6ecd0 service nova] Creating event network-changed:e7be45a5-e6d5-40ec-aec1-5e1463f9272c for instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b on hv-cinder-84984 Jul 18 14:30:13.413249 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [req-8ca18886-dc87-490a-8acd-0875d52c73e9 req-ac99c66d-5418-4d18-a010-8fb36cd6ecd0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033078 Jul 18 14:30:13.414085 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 600/1173] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:30:14.170309 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-60c2c3fd-19b0-4a89-9dd8-6fdeac3fa6f3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:14.171223 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-60c2c3fd-19b0-4a89-9dd8-6fdeac3fa6f3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:14.177530 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c2c3fd-19b0-4a89-9dd8-6fdeac3fa6f3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:14.177975 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c2c3fd-19b0-4a89-9dd8-6fdeac3fa6f3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:14.178724 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c2c3fd-19b0-4a89-9dd8-6fdeac3fa6f3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:14.179804 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-60c2c3fd-19b0-4a89-9dd8-6fdeac3fa6f3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:14.207132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-60c2c3fd-19b0-4a89-9dd8-6fdeac3fa6f3 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040852 Jul 18 14:30:14.207670 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 574/1174] 10.222.0.94 () {58 vars in 1301 bytes} [Mon Jul 18 14:30:14 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:30:14.218960 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:14.219538 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:14.225651 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:14.226708 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:14.227461 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:14.227896 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:14.300720 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.wsgi [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] HTTP exception thrown: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b is not attached to volume ad158287-5fa8-434f-be6b-c7816ccbe44b Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Request method failure captured: Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: request: DELETE /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments/ad158287-5fa8-434f-be6b-c7816ccbe44b HTTP/1.1 Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept: application/json Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Accept-Encoding: identity Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Connection: close Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Length: 0 Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Content-Type: application/json Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Host: 10.222.0.94 Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Openstack-System-Scope: None Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: User-Agent: python-urllib3/1.26.9 Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Auth-Token: gAAAAABi1W258DBRU_xN0UTYfuvBLxNuUIgEZPb_Nh0cSvANv0ulm9F-h65xpFuGsi9DmC8IgbYv5ZXCm457fHQHAxWTwPsSZgy7lSC523Egzibv9voILnBagvVtCtjhNgO0tnBjHCvYgJ3stlqoPoHKIgufIlv2_ukly37kYBndEXcR4y6q-B0 Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Id: None Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Domain-Name: None Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Identity-Status: Confirmed Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Is-Admin-Project: True Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Id: default Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Domain-Name: Default Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Id: 0c3ec8c8d2f84ab1a84a1f64fd8a66c7 Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Project-Name: tempest-TestMinimumBasicScenario-1815024469 Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Role: member,reader Jul 18 14:30:14.303007 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Roles: member,reader Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}] Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant: tempest-TestMinimumBasicScenario-1815024469 Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Id: 0c3ec8c8d2f84ab1a84a1f64fd8a66c7 Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1815024469 Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User: tempest-TestMinimumBasicScenario-1815024469-project Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Id: default Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Domain-Name: Default Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Id: caa872b8a1184533b7b57f0426d2e34c Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: X-User-Name: tempest-TestMinimumBasicScenario-1815024469-project Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: method: > Jul 18 14:30:14.304769 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: exception: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b is not attached to volume ad158287-5fa8-434f-be6b-c7816ccbe44b Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: action_args: {'server_id': '0cf4fc5c-2305-44ba-9197-40dfbcd5d96b', 'id': 'ad158287-5fa8-434f-be6b-c7816ccbe44b'} Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ad158287-5fa8-434f-be6b-c7816ccbe44b. Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:30:14.305730 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b is not attached to volume ad158287-5fa8-434f-be6b-c7816ccbe44b Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b is not attached to volume ad158287-5fa8-434f-be6b-c7816ccbe44b Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR nova.api.openstack.wsgi Jul 18 14:30:14.307329 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Returning 404 to user: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b is not attached to volume ad158287-5fa8-434f-be6b-c7816ccbe44b {{(pid=117845) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:30:14.308709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-dc3ec05e-f210-4c18-a85e-c574c133bdb4 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments/ad158287-5fa8-434f-be6b-c7816ccbe44b" status: 404 len: 154 microversion: 2.1 time: 0.090245 Jul 18 14:30:14.308709 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 601/1175] 10.222.0.94 () {58 vars in 1415 bytes} [Mon Jul 18 14:30:14 2022] DELETE /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b/os-volume_attachments/ad158287-5fa8-434f-be6b-c7816ccbe44b => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:30:15.439889 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:15.441667 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:15.454084 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:15.454538 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:15.455467 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:15.456274 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:15.481569 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Going to try to terminate instance {{(pid=117846) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:30:15.556323 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-92fc51fd-2515-45bf-a90f-b1400577761a tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 204 len: 0 microversion: 2.1 time: 0.122513 Jul 18 14:30:15.557014 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 575/1176] 10.222.0.94 () {58 vars in 1238 bytes} [Mon Jul 18 14:30:15 2022] DELETE /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:30:15.565170 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:15.565785 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:15.572535 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:15.572983 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:15.573752 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:15.574184 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:15.721104 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:30:15.730147 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-891d887b-b31c-43f7-9675-71e846ca3fac tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1555 microversion: 2.1 time: 0.168762 Jul 18 14:30:15.730715 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 602/1177] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:30:15 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:30:16.749113 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:16.749815 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:16.755798 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:16.756275 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:16.757710 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:16.758166 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:16.891997 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.policy [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117846) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:30:16.899398 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-b0335a42-3e04-4ffd-837e-e841cf7d903f tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1555 microversion: 2.1 time: 0.154735 Jul 18 14:30:16.899976 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 576/1178] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:30:16 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:30:17.777332 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:30:17.777995 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:30:17.916414 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:17.917019 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.compute.api [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117845) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:17.923319 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:17.923764 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:17.924578 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:17.925030 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG oslo_concurrency.lockutils [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117845) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:17.935601 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [req-bec6f855-dd79-40d8-ae01-63875e6482b8 req-48edfe2c-1593-4390-a760-ef265a192969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf4fc5c-2305-44ba-9197-40dfbcd5d96b", "name": "network-vif-deleted", "tag": "e7be45a5-e6d5-40ec-aec1-5e1463f9272c"}]} {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:30:17.948534 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-bec6f855-dd79-40d8-ae01-63875e6482b8 req-48edfe2c-1593-4390-a760-ef265a192969 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:17.949132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [req-bec6f855-dd79-40d8-ae01-63875e6482b8 req-48edfe2c-1593-4390-a760-ef265a192969 service nova] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:17.966200 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.compute.server_external_events [req-bec6f855-dd79-40d8-ae01-63875e6482b8 req-48edfe2c-1593-4390-a760-ef265a192969 service nova] Creating event network-vif-deleted:e7be45a5-e6d5-40ec-aec1-5e1463f9272c for instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b on hv-cinder-84984 Jul 18 14:30:17.973831 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [req-bec6f855-dd79-40d8-ae01-63875e6482b8 req-48edfe2c-1593-4390-a760-ef265a192969 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041719 Jul 18 14:30:17.974528 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 577/1179] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Jul 18 14:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:30:17.994915 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.policy [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa872b8a1184533b7b57f0426d2e34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c3ec8c8d2f84ab1a84a1f64fd8a66c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117845) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:30:18.002722 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-3396d5a2-2244-4697-b7f7-b3ef1320a607 tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 200 len: 1513 microversion: 2.1 time: 0.090109 Jul 18 14:30:18.003291 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 603/1180] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:30:17 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 1513 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:30:19.021328 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '>' {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:19.022019 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.compute.api [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [instance: 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b] Fetching instance by UUID {{(pid=117846) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:30:19.028735 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:19.029180 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:19.029931 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:30:19.030363 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG oslo_concurrency.lockutils [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Lock "993bbd6f-2f06-4ad3-80c1-2b3527b2e5c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117846) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:30:19.043703 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.wsgi [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] HTTP exception thrown: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b could not be found. Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Request method failure captured: Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: request: GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b HTTP/1.1 Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept: application/json Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Accept-Encoding: identity Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Connection: close Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Length: 0 Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Content-Type: application/json Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Host: 10.222.0.94 Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Openstack-System-Scope: None Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: User-Agent: python-urllib3/1.26.9 Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Auth-Token: gAAAAABi1W258DBRU_xN0UTYfuvBLxNuUIgEZPb_Nh0cSvANv0ulm9F-h65xpFuGsi9DmC8IgbYv5ZXCm457fHQHAxWTwPsSZgy7lSC523Egzibv9voILnBagvVtCtjhNgO0tnBjHCvYgJ3stlqoPoHKIgufIlv2_ukly37kYBndEXcR4y6q-B0 Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Id: None Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Domain-Name: None Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Identity-Status: Confirmed Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Is-Admin-Project: True Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Id: default Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Domain-Name: Default Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Id: 0c3ec8c8d2f84ab1a84a1f64fd8a66c7 Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Project-Name: tempest-TestMinimumBasicScenario-1815024469 Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Role: member,reader Jul 18 14:30:19.045310 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Roles: member,reader Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_0c3ec8c8d2f84ab1a84a1f64fd8a66c7"}]}] Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant: tempest-TestMinimumBasicScenario-1815024469 Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Id: 0c3ec8c8d2f84ab1a84a1f64fd8a66c7 Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1815024469 Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User: tempest-TestMinimumBasicScenario-1815024469-project Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Id: default Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Domain-Name: Default Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Id: caa872b8a1184533b7b57f0426d2e34c Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: X-User-Name: tempest-TestMinimumBasicScenario-1815024469-project Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: method: > Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: exception: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b could not be found. Jul 18 14:30:19.047132 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: action_args: {'id': '0cf4fc5c-2305-44ba-9197-40dfbcd5d96b'} Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: {{(pid=117846) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b could not be found. Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:30:19.048338 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b could not be found. Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b could not be found. Jul 18 14:30:19.050202 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: ERROR nova.api.openstack.wsgi Jul 18 14:30:19.051752 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: DEBUG nova.api.openstack.wsgi [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Returning 404 to user: Instance 0cf4fc5c-2305-44ba-9197-40dfbcd5d96b could not be found. {{(pid=117846) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:30:19.051752 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO nova.api.openstack.requestlog [None req-ff4ed324-936a-4765-ae24-527fbb7ee9cb tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b" status: 404 len: 111 microversion: 2.1 time: 0.030015 Jul 18 14:30:19.051752 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: [pid: 117846|app: 0|req: 578/1181] 10.222.0.94 () {58 vars in 1235 bytes} [Mon Jul 18 14:30:19 2022] GET /compute/v2.1/servers/0cf4fc5c-2305-44ba-9197-40dfbcd5d96b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:30:19.055033 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: DEBUG nova.api.openstack.wsgi [None req-713579ef-1133-414a-83df-b60f3ce70fcc tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] Calling method '.version_select at 0x7f7b3b3ff0d0>' {{(pid=117845) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:30:19.058081 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: ERROR oslo.messaging._drivers.impl_rabbit [None req-713579ef-1133-414a-83df-b60f3ce70fcc tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [a8558763-4180-45e2-a2f0-d3d4cca4e2d1] AMQP server on 10.222.0.94:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:30:20.067115 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [None req-713579ef-1133-414a-83df-b60f3ce70fcc tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] [a8558763-4180-45e2-a2f0-d3d4cca4e2d1] Reconnected to AMQP server on 10.222.0.94:5672 via [amqp] client with port 35282. Jul 18 14:30:20.085283 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO nova.api.openstack.requestlog [None req-713579ef-1133-414a-83df-b60f3ce70fcc tempest-TestMinimumBasicScenario-1815024469 tempest-TestMinimumBasicScenario-1815024469-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1468173844" status: 202 len: 0 microversion: 2.1 time: 1.033907 Jul 18 14:30:20.085856 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: [pid: 117845|app: 0|req: 604/1182] 10.222.0.94 () {58 vars in 1271 bytes} [Mon Jul 18 14:30:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1468173844 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:30:23.201136 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:30:23.202382 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:30:23.472909 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:30:23.473376 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Mon Jul 18 14:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:32:40.518991 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:32:40.519607 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:32:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:33:37.785680 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:33:37.787150 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:33:43.211462 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:33:43.212107 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:33:43.482254 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:33:43.482830 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Mon Jul 18 14:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:35:23.856343 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:35:23.857018 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Mon Jul 18 14:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:35:39.866299 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:35:39.866926 dv-cinder-849846-1-iscsi devstack@n-api.service[117845]: Mon Jul 18 14:35:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:36:00.527254 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:36:00.527795 dv-cinder-849846-1-iscsi devstack@n-api.service[117846]: Mon Jul 18 14:36:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!